Freelancer profile translated to English.

Description

Freelance Data Engineer - SQL | Python | AWS | Airflow | ETL

Looking for a Data Engineer capable of designing and automating your ETL/ELT pipelines, with a real focus on quality, performance, and business impact?

I will support you from start to finish: ingestion, transformation, cloud storage, orchestration, CI/CD.

What I offer:

- Multi-source data integration.

- ETL/ELT pipeline design.

- Orchestration with Airflow.

- Big Data management with Spark on Databricks (Lakehouse with Delta Lake).

- Data modeling (star, snowflake).

- Cloud expertise (AWS), CI/CD (GitHub Actions), DevOps best practices.

Why trust me?

- 3 years of experience on complex data projects.

- Optimization of ETL/ELT pipelines and SQL queries to reduce costs, processing times, and improve performance.

- Committed and persevering, known for pragmatically solving complex problems and delivering high-quality work, sparing no effort to achieve objectives.

- 2 open-source projects developed in data.

- Ability to collaborate with technical and business profiles (requirements gathering, clear reporting).

- Culture of documentation, code quality, and mastered production deployment.

Languages

French
Native or bilingual
English
Fluent
German
Conversational

Workplace preferences

Can work on-site

Paris (up to 50km), Rennes (up to 50km), Lyon (up to 50km), Strasbourg (up to 50km), Lille (up to 50km)

Projets Open Sources
Data Engineer
RETAIL (LARGE RETAILERS)
October 2024 - Today (1 year and 10 months)
Paris, France
Development of 2 open-source projects using modern technologies:

Project 1: Retail Insights Simulator, Cloud ETL Pipeline (Airflow, Python, AWS):
Development of an ETL pipeline in a retail environment to produce business KPIs from raw data:
- Pipeline orchestration with Airflow hosted on an AWS EC2 instance (optimized costs).
- Ingestion and transformation of data (sales, customers...) and optimized storage in Parquet on Amazon S3.
- Interactive visualization of KPIs (revenue, margin, average basket size...) via a Streamlit interface hosted on an AWS EC2 instance.
- CI/CD with GitHub Actions (unit tests, code quality, automated deployment).

Project 2: CarbonCity Insights, Vehicle Carbon Analysis API (FastAPI, PostgreSQL, Redis):
Design of an API to consult and compare vehicle carbon emissions, with integration of an external source:
- Backend development with FastAPI (JWT authentication, pagination, filters, emission comparison).
- Ingestion of data from the Carbon Interface API, storage on PostgreSQL, Redis cache for optimization.
- Cloud deployment and automation of monthly updates via a cron job integrated into a Docker container.

Technologies used: Python (Pandas, Streamlit, FastAPI, Plotly), SQL, Airflow, AWS (EC2, S3, Athena, Lambda), Docker, GitHub Actions (CI/CD)
Python SQL Amazon Web Services Airflow Databricks
Sopra Steria
Data Engineer
SOFTWARE PUBLISHING
April 2022 - May 2024 (2 years and 1 month)
Puteaux, France
Intervention on data projects related to a business ERP (ULIS) in the real estate sector.
- Design of an ETL pipeline to synchronize data between the ERP and a mobile application for 200+ building managers:
---- Facilitation of business workshops to gather requirements and model flows.
---- Modeling of a dedicated database for the mobile application (GDPR compliance).
---- Automated orchestration of the ETL pipeline via Airflow, with error handling and notifications.
---- Definition and population of KPIs for agency directors to monitor activity.
- Migration during the merger of 3 housing associations:
---- Facilitation of business workshops to gather client needs.
---- Extraction of data from 3 different sources, data cleaning and standardization.
---- Integration of data into the ULIS ERP, with post-migration consistency checks.
- Development of complex SQL queries (joins, CTEs, window functions) to meet business needs.
- Mentoring junior consultants: explaining SQL concepts and assisting with technical blockers.

Technologies: Python, Advanced SQL, ETL, Linux, Airflow, ULIS ERP
Python SQL Airflow
amazon
Logistics Team Manager
E-COMMERCE
January 2021 - April 2022 (1 year and 3 months)
Osny, France
Supervision of a team of 40 to 100 logistics operators depending on seasonality:
- Optimization of a labeling station, resulting in a +12% productivity gain.
- Organization of internal events to improve team cohesion and reduce turnover.
- Reactivity to unforeseen events (e.g., unexpected receipt of 4000 packages → rescheduling of non-urgent packages and team reallocation).
- Production of weekly reports for Amazon teams based in Dublin (KPIs, incidents).
Macro VBA Excel