Freelancer profile translated to English.

Description

Data Engineer with a strong command of SQL, Python, and Git, I design and optimize robust, scalable, and business-oriented data pipelines.

I work across the entire data transformation chain, with particular expertise in using dbt (data build tool) to structure, test, and document reliable and maintainable data models.

Languages

English
Native or bilingual
French
Native or bilingual
Arabic
Native or bilingual

Workplace preferences

Remote only

Primarily works remotely

CGI ICDC- Taxonomie européenne
Data Engineer Consultant
July 2024 - Today (2 years and 1 month)
Paris, France
Implementation of Pyspark pipelines that allow:
*Ingestion and preprocessing of data from Excel files, and storage in the raw database

*Data processing: cleaning, transformation, joins, calculations.

*Production of tables and business intelligence reports that meet business needs.
Industrialization of Python code.
Deployment and operational and evolutionary maintenance of code.
Leading and participating in technical design workshops.
Migration from Spark2 to Spark3.
Analysis of client needs to define solutions adapted to business challenges.
Technical Environment: Cloudera, Python, Spark, Hive, Atlassian, Git, Jenkins
Python PySpark Data Cleaning and Preprocessing SQL Agile Methodology
EDF / DNPT DPNT:
Data Engineer Consultant
January 2023 - June 2024 (1 year and 5 months)
Paris, France
Development of Spark/Scala workflows.
Migration from Oozie to Airflow
Execution of the data migration project from Hadoop to Oracle.
Development of tables and views (HQL).
DEVOTEAM Malakoff Humanis
Data Engineer Consultant
June 2022 - December 2022 (6 months)
• Data Ingestion
• Improvement of Talend jobs
• Implementation of data extraction applications
• Definition of data flows
Technical Environment: SQL, Talend (OS)