Li Shi

Leading the design of a use-case-oriented Data Platform, meeting technical and business challenges. Facilitating collaborative workshops for gathering and analyzing user needs, using a use-case-driven development approach to centralize contributions from all teams. Synthesizing use cases and developing a solution proposal aimed at optimizing the Data Platform. Coordinating with a team of experts for the evaluation, adjustment, and validation of the solution, including defining the main components: orchestration, observability, data quality, and transformation. Defining technical specifications for inter-component exchanges, based on an event-driven architecture via Pub/Sub. Defining technical specifications for orchestration, using Cloud Composer. Designing and developing a Proof of Concept (PoC) to validate technical and functional feasibility. Presenting the PoC to stakeholders and integrating feedback to refine the solution. Developing and implementing the final solution (orchestration component and Pub/Sub part), adhering to best practices in the field. Designing and implementing CI/CD pipelines to automate deployments, tests, and component standardization. GCP, Cloud Composer, Data Galaxy, BigQuery.

Data Governance - Anonymization Project

Project: Integrate real-time customer information. Create, update, and merge user data in Cloud SQL according to industry requirements. Use Cloud Run to retrieve external data and create BigQuery tables. Develop BigQuery scripts with Dataform. Modify and refine data structures and technical structures. Technical environment: Terraform, Cloud Run, Cloud SQL, Dataform, Cloud Build.