Freelancer profile translated to English.

Description

Data Engineer**, I help companies leverage their data and integrate AI solutions to improve productivity and decision-making. Specialist in **Big Data(Apache Spark, Hadoop) and advanced analytics, I offer:

Data Analysis and Valorization:Transformation into strategic insights with Java and Spark.

Development of Data-Driven Applications:Tailored solutions to exploit data.

Data and AI Strategy Consulting:Identification of use cases and a clear roadmap.

Experienced in various sectors (aeronautics, energy), I adapt to your needs for efficient and accessible solutions. Contact me to discuss your project!

Industry field of expertise

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Cannes (up to 50km)

Enedis
Data Engineer
May 2022 - March 2023 (10 months)
Context
Joined a team of 10 developers to modernize the data processing infrastructure for 30 million Linky meters, aiming to improve the performance and reliability of large-scale processing.

Missions and achievements

## Optimization of Big Data processing

- Development and refactoring of Spark jobs
- Reduction of processing execution time by 40% through optimization of partitions and memory management
- Migration of legacy jobs to Spark 3

## Industrialization and quality

- Implementation of an automated testing strategy (unit, integration)
- Setup of CI/CD pipelines (Jenkins) with pre-deployment validation

## Monitoring and reliability

- Design of a processing metrics tracking system
- Detection of "empty" jobs (successful without processed data)

Technical environment
Spark 3, Java 11, Spring, Scala, Ceph/S3, Git
Amadeus
Developer and Tester
June 2021 - March 2022 (9 months)
Context
Member of a team of 3 developers responsible for a critical fast data platform processing real-time streams for major airlines' aeronautical operations, with strict availability requirements.

Missions and achievements

- Development of new features for microservices in Java/Scala
- Implementation of a testing strategy (unit, integration, E2E)
- Development of Robot Framework scenarios for testing
- Elimination of production regressions

Technical environment
Java 11, Scala, Kafka, MongoDB, OpenShift/Helm, Docker Desktop, CI/CD, SAFe Agile, Robot Framework, JUnit, Postman, SonarQube
Air France
Big Data Developer
March 2019 - May 2021 (2 years and 2 months)
Valbonne, France
Context
First developer on a brand new data lake project, tasked with structuring data to make it usable by operational and analytical teams. Worked largely autonomously on the technical side for most of the assignment, with close collaboration with KLM teams consuming the data.

Missions
- Design and development of raw data processing pipelines
- Transformation of XML/JSON data into structured Parquet datasets
- Operational maintenance and monitoring of production jobs

Results
- Data lake growth: from 5 to 50+ structured datasets in 2 years; integration of 15+ heterogeneous data sources.
- Improved usability: comprehensive documentation enabling adoption by new users; reduced data access time for analysts.
- Operational efficiency: stability of production jobs, automation of processes reducing manual interventions; groundwork laid for industrialization with the arrival of a second developer.

Technical environment
Spark 2 (Core, SQL, Dataset), Hadoop (HDP 2.6, HDFS, YARN), Kafka, Java 8, Python, PySpark, Bash, Control-M, MongoDB, Spring Boot, Cloud Foundry