Freelancer profile translated to English.

Description

Lead Data Engineer with over 6 years of experience in designing and implementing data platforms on AWS and Databricks. Holder of a Master's degree in Data Science & Big Data from the University of Paris-Est Créteil, I work on data governance, data migration, cloud architecture, and Big Data processing industrialization. I have strong expertise in Databricks, AWS, and modern data architectures.

Lead Data Engineer – Databricks Expert - AWS Devops
Certified Databricks Data Engineer Professional and GenAI
I support companies in the design, migration, and industrialization of high-performance and scalable data platforms.
I work end-to-end: cloud infrastructure, data pipelines (Bronze / Silver / Gold), CI/CD, Databricks governance, and production deployment.
Experienced in complex and critical environments, I transform legacy or cloud data architectures into reliable, secure, and business-oriented platforms.
Stack: Databricks, AWS, Spark / PySpark, Terraform, CI/CD, GitLab, Datadog, Hadoop, Hive, Python.

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Paris (up to 50km)

ENGIE
LEAD DATA | DATABRICKS EXPERT
ENERGY AND UTILITIES
March 2025 - Today (1 year and 5 months)
La Garenne-Colombes, France
**Project**: Migration of the B2C Data Platform to Databricks Unity Catalog in an AWS environment.

Support Feature Teams in migrating data from the Common Data Hub (CDH) to Unity Catalog
Progressive migration of data stored on S3 to Unity Catalog in External mode to ensure compatibility with existing jobs
Implementation of the Medallion architecture (Bronze, Silver, Gold) on Databricks
Creation of catalogs, schemas, volumes, and governance assets in Unity Catalog
Configuration of Storage Credentials and External Locations with dedicated IAM roles
Leading technical workshops with Feature Teams to structure data and define migration strategies
Definition of groups and management of user authorizations according to business roles
Management of permissions and security of access to catalogs, schemas, and tables
Support for teams in migrating jobs to Unity Catalog (reading/writing via managed tables)
Configuration of Unity Catalog-compatible Databricks clusters
Implementation of ingestion pipelines from external sources such as Salesforce
Creation of Service Principals for secure execution of jobs and pipelines
Migration of External tables to Managed tables
Development of Databricks applications to facilitate data management and input by business users
Implementation of technical monitoring jobs to supervise processing and resource consumption
Implementation of Databricks skills with Genie Code to industrialize job migration to Serverless mode (eligibility analysis, automated migration, and validation)
Creation of monitoring dashboards for asset tracking and configuration drift detection
Contribution to improving data governance, traceability, and access security
Databricks AWS Generative AI PySpark Monitoring
RATP
Data Engineer | AWS DevOps - Databricks
TRANSPORTATION
November 2022 - January 2025 (2 years and 2 months)
Paris, France
**Project**: Implementation of infrastructures and delivery of key technical components necessary for the operation of a use case in a cloud environment

Build of the infrastructure on the data platform
Provisioning of use case resources in Databricks and AWS via Terraform
Implementation of CI/CD pipelines for infrastructure deployment
Assignment and management of authorizations via groups in Databricks
Ensuring operational maintenance and infrastructure evolution
Data migration from OnPrem to the landing zone on S3
Data ingestion from the landing zone to the different data vaults (bronze, silver, gold) in Databricks catalogs
Monitoring of ingestion jobs through DataDog dashboards
Resolution of infrastructure and pipeline incidents
On-Prem platform O&M
Handling ad-hoc requests concerning the addition of users, HDFS space
Terraform Databricks AWS Spark Gitlab CI/CD
URSSAF/ ACOSS
Big Data Engineer / DevOps
PUBLIC SECTOR
September 2021 - November 2022 (1 year and 2 months)
Paris, France
**Project**: Migration of the DPAE (prior declaration of employment) project to Big Data.

Development of Spark jobs (Python) for imputing missing values by contract type, fixed-term contract duration, gender, and age.
Development of Spark jobs (Python) for creating a summary table of prior declarations of employment since 2000.
Development of Spark jobs (Python) for duplicate checks and calculation of delay rates and late corrections.
Development of Sqoop import jobs from Oracle.
Data storage in ORC format on HDFS
Development of HQL scripts for Hive tables (ORC, Parquet formats)
Monitoring of processing launches and log analysis with the Resource Manager.
Performing unit and integration tests.
Scheduling of chains with Oozie.
SAS user support on the entire Big Data environment
HDFS Hive CI/CD PySpark SQL