Freelancer profile translated to English.

Description

Data Engineer with nearly 3 years of experience in designing, industrializing, and optimizing distributed data pipelines processing several terabytes per day. Specialized in Spark/PySpark environments and Data Lake/Lakehouse architectures (Databricks, Delta Lake). Recent freelance experience on ETL pipeline projects for various clients. Focused on performance, data quality, and governance of analytical platforms.

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Lyon (up to 50km)

Mission Client
Data Engineer
RETAIL (LARGE RETAILERS)
November 2025 - July 2026 (8 months)
Dakar, Senegal
Design and development of ETL/ELT data pipelines for ingesting, transforming, and making data available from various sources (REST APIs, CSV/JSON files, databases) in a cloud environment.
Data modeling and structuring according to a Data Lakehouse architecture (Bronze, Silver, Gold), with optimization of Spark/PySpark processing and storage formats (Parquet/Delta).
Implementation of automated data quality controls (schema validation, duplicate detection, missing value management, business consistency) as well as monitoring and supervision of pipelines in production.
Development of SQL and Python processing for data cleaning, enrichment, and aggregation to meet clients' analytical and decision-making needs.
Orchestration and automation of data processing workflows, error management, incident recovery, and pipeline performance optimization.
Independent project delivery: requirements gathering, technical scoping, development, unit and functional testing, documentation, and user support.
Spark SQL data-integration Databricks Cloud GCP
Bedrock streaming
Data Engineer
ENTERTAINMENT AND LEISURE
September 2023 - October 2025 (2 years and 1 month)
Lyon, France
Designed and maintained distributed pipelines under Databricks (Spark/PySpark) processing several TB of data per day for a large-scale streaming platform.
Reduced processing times in production by 20% to 30%. Optimized Spark jobs (partitioning, caching, rewriting transformations).
Implemented automated data quality controls (consistency tests, alerting, anomaly detection): zero major SLA incidents in 2 years.
Orchestrated workflows via Airflow and modeled data in a Delta Lake environment (evolving schemas, compaction, ACID tables).
Collaborated with Engineering and Product teams on the evolution of the data architecture.
Databricks Airflow Spark SQL Cloud AWS
HawkCell
Medical Image Processing Engineer
MEDICAL
February 2023 - August 2023 (6 months)
Lyon, France
Development of MRI super-resolution algorithms (Python, NumPy, SimpleITK) improving image quality by +15% PSNR and +10% SSIM.
Training and evaluation of Deep Learning models for high-resolution image reconstruction.
Optimization of script execution time by 50% through vectorization and parallelization of processing.
Writing technical documentation and knowledge transfer to the R&D team.
Python (Programming Language) Machine Learning & Deep Learning simpleITK