Freelancer profile translated to English.

Description

I design and develop custom data solutions that are robust and scalable. My approach is simple: understand your business challenges to deliver pipelines and architectures that hold up. I also work on audit and consulting missions, and the creation of POCs.

✅ Expertise:

• Data architecture (cloud & on-premise)

• Processing pipelines (Spark, Airflow, DBT)

• CI/CD & MLOps

• Data quality & governance

Industry field of expertise

Languages

English
Native or bilingual
French
Native or bilingual

Workplace preferences

Remote only

Primarily works remotely

Confidential
Tech Lead Data Engineer
September 2021 - November 2023 (2 years and 2 months)
Design and Implementation of various Data solutions on GCP and OnPremise

• Creation of ELT/ETL pipelines

• Creation of connectors (file, api, kafka)
• Data security

• Connection to the existing Collibra data governance `
• Data exposure via PowerBI
• Implementation of a data quality control and profiling layer

Technologies used:
• DBT
• Apache Spark SQL
• Apache Airflow/Composer/Ctrl-M
• Apache Kafka
• PostgreSQL
• GCP Services: GCS, BIGQUERY, Pub/Sub, KSM
Société Générale
Senior Data Engineer
BANKING AND INSURANCE
August 2019 - September 2021 (2 years and 1 month)
Implementation of a Lakehouse platform from-scratch on the Azure Cloud

• Creation of connectors for data ingestion (batch/Kafka CDC)
• Data cleaning by creating consolidated views
• Data normalization - Dataset creation
• Business data enrichment - Datamart creation
• Data exposure via API development (Spring Boot) and PowerBI
• Monitoring via ELK suite

• Implementation of data quality control tools
• Delta Lake Tables

• Airflow Orchestration
• Modeling supported SCD2 and SCD3
• Languages used: Python, Java
Thales
Big Data Developper
TELECOMMUNICATIONS
March 2016 - July 2019 (3 years and 4 months)
Development of Big Data Python and Java applications.

Development of jupyter notebooks
Project management: SCRUM methodology
Challenges Met:
• Refactoring of the macro interpreter
• Applications with strong processing speed constraints
• Migration from HDF5 to HDF5-swmr
• Refactoring of the Java multi-thread system
• Unstructured data