Yahya M.

Redesign of the data architecture and optimization of GCP costs as part of the migration of the SAS ecosystem to GCP.

• Design of an ELT platform based on Cloud Storage, Airflow, DBT/Dataform, and BigQuery

• Migration of logs from ElasticSearch to BigQuery, saving +€2000/month

• Migration of Cloud Composer Airflow 1 to 2 and refactoring of DAGs

• Management of user rights and roles (IAM) in GCP

• Implementation of GCP resources in Infrastructure as Code via Terraform

• Optimization of GCP costs and creation of custom LookerStudio dashboards for budget monitoring

• Proactive analysis and resolution of vulnerabilities detected via the Wiz security platform Bigquery, Airflow, DBT/Cloud Dataform, Pub/Sub, Python, Terraform, CI/CD, Lookerstudio, Wiz

Worked on the I3 project as a Senior Data Engineer Freelancer. The I3 project is a solution that allows retailers to offer their customers ultra-personalized discount coupons.

• Initiation and development of the Data Analytics platform: Management and optimization of the Bigquery data warehouse, data processing via Dataform.

• Development and maintenance of a Python FastAPI API to communicate with the I3 web application, deployed on Google Cloud Run.

• Synchronization of a Postgresql Cloud SQL database to Bigquery using Google Cloud Datastream.

• Development and maintenance of several custom data ingestion pipelines

• DevOps: Creation and running of GCP resources in IaC via Terraform

• DevOps: Maintenance of CI/CD GitLab pipelines

• Training teams on the use of Lookerstudio Pro

• Management of a team of 3 data engineers: Leading weekly meetings, task allocation, code reviews. Google Cloud Run, Google Cloud Dataform, Pub/Sub, Google Cloud Scheduler, Python, Terraform, Lookerstudio Pro

I joined Brut in April 2020 and contributed, as a Senior Data Engineer, to the development of the data platform for Brut Media, BrutX (streaming service), and Brut Live.

• Creation of the data platform for Brut, BrutX, and Brut Live (from scratch), Bigquery data warehouse

• Development of custom connectors for social media APIs: Python, Flask, Cloud Run, Cloud Tasks, Dataflow (Apache Beam)

• Creation of CDC pipelines via Stitch

• Creation and running of GCP resources in IaC via Terraform

• Management of a team of 4 data engineers: Leading weekly meetings, task allocation, code reviews.

• Technical expertise and architecture choices on Python, GCP, and databases (Postgresql & Bigquery). Google Cloud Platform, Python, Terraform, CI/CD, Stitch Data, Postgresql, Social Media APIs (Meta, Snap, TikTok, Youtube, Google Analytics)