Freelancer profile translated to English.

Description

Title: Data Engineer GCP | BigQuery | dbt | Terraform | 5+ years of experience

About: Certified Data Engineer with over 5 years of experience, I support companies in modernizing their data architecture and industrializing their pipelines. A graduate of IMT Lille Douai, I have developed a dual expertise: the robustness of Microsoft environments (SSIS/SQL Server) and the agility of the Cloud (GCP).

Languages

French
Native or bilingual
English
Basic

Workplace preferences

Can work on-site

Lille (up to 50km), Paris (up to 50km)

otteo
Data Engineer (Internal Project / POC for the E-commerce Sector)
DIGITAL AND IT
June 2024 - Today (2 years)
 Data Ingestion (Bronze Layer): Development of automated flows for extracting catalog and transactional data via REST API, and secure raw storage in Azure Data Lake Storage Gen2 (ADLS).
 Transformation (Silver & Gold Layers): Creation of distributed processing pipelines with PySpark on Azure Databricks. Cleaning, deduplication, handling of null values, and calculation of business aggregates (sales KPIs, product ratings).
 Optimized Storage: Implementation of the Delta Lake format across all transformed layers to ensure transaction integrity (ACID) and facilitate historical tracking.
 Orchestration: Design and deployment of DAGs in Apache Airflow to schedule, automate, and monitor the end-to-end daily execution chain.
 Business Intelligence: Modeling and creation of analytical dashboards on Power BI directly connected to the Gold layer for product catalog performance management.
 CI/CD & Best Practices: Code versioning on GitHub, creation of architecture diagrams (Mermaid), and writing of technical project documentation.
Microsoft Azure (ADLS Gen2) Azure Databricks PySpark Python Delta Lake
Leroy Merlin (Via Otteo)
Data Engineer
June 2024 - February 2026 (1 year and 8 months)
"Data in Product" around product data and commercial performance. The main objective is to improve the quality, reliability, and automation of data flows, while supporting business teams in the exploitation and valorization of data through modern Cloud solutions.
• ➢ Data Quality (SOS DATA): Development of a steering tool for feedback on 1P product descriptive data. Quality monitoring, anomaly analysis, and implementation of corrective action plans.
• ➢ Automation & Data in Product (EURO & KANPAI CHALLENGES): Automation of data preparation for supplier attribute completion campaigns. Feeding of digital products Mappee (LMFR BU) and Kanpai (Multi-BU).
• ➢ Data Engineering (WTP): Implementation of pipelines for ingesting and processing commodity and price data (What's The Price). Import from SFTPGo, transformation, and publication in BigQuery.
• ➢ Development of unit and non-regression tests (dbt tests) integrated into CI/CD pipelines to ensure deployment reliability.
• ➢ Business Intelligence (MEGA DIAG): Implementation of a global dashboard for steering market performance (Sales, Stock, Margin, Omnichannel) with specific analysis axes.
• ➢ Decision Support Tool (PCO): Design of a consolidated dashboard for Commerce Pilots, replacing Google Sheets files to centralize daily monitoring.
• ➢ HOME INDEX: Contribution to the construction of performance indicators on product offering visibility.

Environment: GCP, BigQuery, dbt, Terraform, Kestra, GitHub, CloudCraft, Soda, Power BI, Google Apps Script, MyCloud Console, GenAI (Copilot).
AUCHAN Retail France
Data Engineer
December 2021 - March 2024 (2 years and 3 months)
Intervention within the Data Force (team of 6 people) with the main mission of data retrieval via the Ataccama ETL on the GCP platform.
• ➢ Project Evolution (Data Quality): Project Lead. Development of ingestion and cleaning flows in Python (Pandas) to manage the complexity of JSON files and anomaly generation, replacing old Shell scripts. Ensuring optimal data descent via a Data Studio dashboard.
• ➢ Project (Referencing): Writing specifications, and developing data ingestion via APIs in Python and Shell.
• ➢ Data Pipeline Orchestration: Design and development of DAGs in Python on Apache Airflow (GCP Cloud Composer) to orchestrate and monitor the end-to-end chain (triggering Python extractions, executing Ataccama jobs, BigQuery SQL queries).
• ➢ Writing unit tests to validate Shell scripts and feeding flows before production.
• ➢ Project:
• ➢ Development of jobs on Ataccama.
• ➢ Data presentations and queries on BigQuery.
Environment: Ataccama, Apache Airflow (Cloud Composer), Dbt, GCP, BigQuery, Google Data Studio, SQL, Google Storage, Python (Pandas), Shell, Jira, GitLab, Hibou

Check out Fodouop's experience

Be the first to recommend Fodouop

Help this freelancer shine by sharing your experience working together.

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

Baptiste Duhen

Fullstack developer

4.6

(4)

Amed Hamou

Senior Lead Developer

(2)

Audrey Champion

Web developer

4.3

(3)

Signup to reveal

Engineer in Business Intelligence Information Systems
IMT LILLE
2019
Ingénieur en système d'information décisionnel
Data Integration Training
Udemy
2021
Formation Data Intégration sur

Fodouop Dimitri

Data Engineer

About Fodouop

Experience

Recommendations

These freelancer profiles also match your criteria

Education

Skill set

Categories