Freelancer profile translated to English.

Description

I am an experienced Data engineer, specializing in the design of ETL/ELT pipelines with Spark in Scala, in an AWS environment (EMR, S3, Lambda, Batch, ...) for the production of data products.

I am comfortable with Python, which I use with Airflow to manage the smooth execution of projects. I have also learned CI/CD on Gitlab, and resource management with Terraform. I am always in a good mood during SCRUM meetings because I enjoy collaborating with teams and contributing to the achievement of common goals.

I am eager to discover new projects, as opportunities to acquire new skills!

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Paris (up to 50km)

Kering
Big Data Engineer
LUXURY GOODS
August 2023 - January 2025 (1 year and 5 months)
Paris, France
Continuous improvement of Spark applications in Scala and Python in the context of migrating services from AWS (lambda, batch, s3, Athena, emr...) to GCP. Management of data flows with Airflow (AWS & GCP). Refactoring of data products under the data mesh model on GCP with a Terraform/DBT stack. API management with Airbyte. Git versioning, Jenkins/GitHub deployment. Support aided by Grafana. Other keywords: Jupyter, Pycharm, Intellij, vscode, copilot
Gitlab CI/CD Terraform Python AWS Google cloud
Canal+
Data engineer
PRESS AND MEDIA
April 2021 - August 2023 (2 years and 4 months)
Puteaux, France
As a Data Engineer, I created and refactored Spark applications in Scala managed on Airflow2 to enable user consumption tracking while adhering to GDPR anonymization rules. I worked in an AWS cloud environment with services like S3, EMR, ParameterStore... while managing resources and permissions with Terraform.
I also worked on several service migrations, from Redshift to Snowflake, Bitbucket to Gitlab, EMR to EMR Serverless.
I continuously participated in acceptance testing, anomaly analysis, and incident resolution.
Scala AWS Python Airflow Snowflake
TeamViewer
Big Data Engineer
October 2019 - September 2020 (11 months)
Berlin/Brandenburg Metropolitan Region, Germany
Debugging existing pipelines (Scala/SQL/Airflow). Fetching and delivering new data for marketing reports. Writing policies for data cleaning and storage optimization (AWS/Airflow): 20% of storage saved on the Redshift data warehouse.
Airflow Scala SQL Python Gitlab CI/CD