Freelancer profile translated to English.

Description

Senior Data Engineer with 11 years of experience, including 4 years as a Full Stack Java JEE developer and 7 years as a Data Engineer.

I have worked for 4 years on the GCP cloud, developing batch data processing via Spark and dbt jobs, as well as real-time data processing with Kafka Streams and Kubernetes.

I also have 1.5 years of experience on the Azure cloud, with Kubernetes, CI/CD, Spark, and Spring Boot API development...

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Paris (up to 50km)

Société Générale
Senior Data engineer
BANKING AND INSURANCE
July 2024 - Today (1 year and 11 months)
Paris, France
During this assignment, I was part of a project that involved migrating a system from Oracle to Big Data.
Migration of SQL processing to Spark jobs. The project involved reconciling trading data from multiple sources, including Bloomberg...
Mission and main tasks:
✔ Contribute to the technical architecture of new projects.
✔ Contribute to the breakdown of Jira tickets for a project.
✔ Migrate Spark jobs to Kubernetes from HD Insights, deploy and size clusters.
✔ Implement Kubernetes deployment scripts.
✔ Automate Jenkins pipelines to deploy Spark jobs and Java applications on Kubernetes.
✔ Develop Spark jobs, and implement unit and integration tests.
✔ Participate in daily stand-ups, story estimation, sprint planning...
Kubernetes Spark Cloud Azure Spring boot CI/CD
Louis Vuitton
Data engineer
LUXURY GOODS
March 2024 - June 2024 (3 months)
Paris, France
During this assignment, I was part of the Supply Chain team, working primarily on the logistics project. The project aims to harmonize KPIs and logistics processes across different regions, enabling continuous improvement of operations. The final objective is to have a global and unified view of warehouse performance.
Mission and main tasks:
✓ Contribute to the technical architecture of new projects.
✓ Contribute to the breakdown of Jira tickets for a project.
✓ Expose data and perform transformations using DBT (ingestion, data transformation, creation of new macros...).
✓ Schedule jobs using Airflow DAGs.
✓ Create APIs to expose data to clients with Elasticsearch or Datastore as the backend.
✓ Participate in daily stand-ups, story estimation, sprint planning...
Airflow DBT Python Terraform Cloud GCP
Carrefour
Cloud Data engineer
RETAIL (LARGE RETAILERS)
October 2020 - March 2024 (3 years and 5 months)
Massy, France
During this assignment, I was part of 3 teams: the Software Factory team, where I primarily worked on the GCP cloud migration, on Cloudera Spark jobs (HDFS/YARN) to (GCS/Dataproc), and on evolutions and maintenance of projects on Spark, Spark Streaming jobs... for 1.5 years. Subsequently, I was part of the Supply team for 6 months and the Merchandise team for 1.5 years, where I developed Spark jobs, Kafka Streams, and SQL queries on BigQuery...
Mission and main tasks:
✓ Migrate Spark jobs to Dataproc, deploy and size Dataproc clusters.
✓ Develop new Spark jobs for new data normalization needs from raw data to BigQuery.
✓ Develop and deploy Kafka Streams jobs for real-time processing needs.
✓ Develop data exposure APIs on Elasticsearch, Bigtable, Cassandra as backend.
✓ Implement Kubernetes and Ansible deployment scripts.
✓ Implement unit and integration tests.
✓ Participate in the design of technical architectures for new projects.
✓ Participate in daily stand-ups, story estimation, sprint planning...
Apache Kafka Elasticsearch Kafka Streams Apache Spark Cloud GCP