Freelancer profile translated to English.

Description

Data Engineer avec 3 ans d’expérience sur des environnements Big Data, spécialisé dans l’ingestion, le traitement et le stockage des données.

Expertise sur Databricks, Spark (PySpark), SQL, avec des restitutions analytiques via Power BI.

Languages

French
Native or bilingual
English
Conversational

Workplace preferences

Remote only

Primarily works remotely

Thales Services Numériques missionné par Total Energies
Data Engineer Databricks
ENERGY AND UTILITIES
December 2024 - Today (1 year and 8 months)
Paris, France
Context
Design and implementation of data pipelines for data extraction, transformation, and loading (ETL)
Achievements
Data collection on Azure Data Lake
Reading data, anonymizing sensitive data, and storing it in the Bronze layer
Data transformation in Azure Databricks and storage in the Silver layer
Modeling dimension and fact tables and storage in the Gold layer
Scheduled daily pipeline job execution
Visualization of data stored in the Gold layer
Results

Technical environment: Python, Spark, Azure Databricks, Azure Data Lake, Git, Power Bi
Databricks Microsoft Power BI Apache Spark Microsoft Azure
Thales Services Numériques missionné par URSSAF
Data Engineer
PUBLIC SECTOR
September 2022 - October 2023 (1 year and 1 month)
Vélizy-Villacoublay, France
Achievements:
Collection and transformation of DSN (Déclarations Sociale Nominative) data required for social protection organizations to collect contributions or levies to serve employee benefits resulting from payments.
Data transformation for social protection organizations: organizing and structuring data with Pyspark
Collaboration with testers and Business Analysts to validate development results.

Technical environment: Python, Spark, Git.
PySpark Agile methodology
BOURSORAMA SA
Data Engineer
BANKING AND INSURANCE
September 2020 - September 2021 (1 year)
Boulogne-Billancourt, France
Context:
My mission was mainly to work on Data Quality within Boursorama.
Achievements:
Implementation of pipelines for ingestion, transformation, and storage.
Development of tools to verify data quality in the datalake (schema change detection, data profiling)

Development of a tool for data profiling.
Tools: Spark, Zeppelin, Vs Code , Git.
Agile methodology Apache Spark Scala SQL