Freelancer profile translated to English.

Description

Data Engineer since 2015, with experience starting in 2011, I specialize in GCP, Spark, and Kafka technologies. My passion lies in designing and optimizing robust data pipelines. Expert in managing massive flows, I excel at creating efficient solutions to harness the potential of data. Ready to take on new challenges and contribute to the success of projects focused on intelligent data management.

Languages

French
Fluent
English
Fluent
Chinese
Native or bilingual

Workplace preferences

Can work on-site

Paris (up to 50km), Paris (up to km)

Groupe Renault
Big Data & Cloud Engineer
AUTOMOBILE
July 2019 - Today (6 years and 11 months)
Le Plessis-Robinson, France
▪ Migration of the HDP infrastructure to the Google Cloud Platform (GCP).
▪ Definition, design, and architecture of the migration phase.
▪ Implementation of the BigQuery UpsertOperator, used for upsert data ingestion into BigQuery.
▪ Implementation of Cloud Function, PubSub, and Cloud Storage, triggering Composer DAGs upon reading flags (among the first teams to implement this functionality within Renault).
▪ Implementation of the CompareOperator, used to compare BigQuery tables.
▪ Implementation of the project foundation with Dataflow Java (ingestion, processing, validation, and publication of signals, etc.).
▪ Implementation of BigQuery UDF for language detection.
▪ Implementation of Looker Studio monitoring on Composer DAGs.
▪ Development of the Elasticsearch_Template library, used to administer Elasticsearch templates.
▪ Development of the Dataproc_dll library, used to index Elasticsearch documents in different modes.
▪ Development of airflow_dependencies: a central tool for Composer projects.
▪ Implementation of the CI/CD pipeline under GitLab.
▪ Migration from Composer 1 to Composer 2.
▪ PoC of Cloud Translation for language detection and translation.
▪ Migration from Dataproc 1.4 to 2.1.
▪ Migration from Elasticsearch 7.17 to 8.4
GCP Dataflow Composer Spark Hadoop Scala Oozie Hive Yarn Hue Zeppelin Elasticsearch Big Query Gitlab CI/CD
La Poste
Big Data Engineer
LOGISTICS AND SUPPLY CHAIN
September 2017 - July 2019 (1 year and 10 months)
Issy-les-Moulineaux, France
▪ Architecture of new projects, solution design
▪ Development of applications for various projects in Kafka, Scala
▪ Implementation of the application for real-time detection of transactional fraud with Machine Learning on the Kafka platform
▪ Implementation of the application for real-time marketing campaigns using Kafka Streaming with Scala
▪ Development in Spark Scala
▪ Development in Ansible
▪ Application testing
▪ Optimization of the application to consume fewer resources and run faster
▪ Code review
Apache Kafka Machine learning Spark Scala Ansible Docker Elasticsearch Airflow Mesos
Black Tiger
Data Engineer
SOFTWARE PUBLISHING
November 2015 - September 2017 (1 year and 9 months)
Issy-les-Moulineaux, France
▪ Project architecture: design and proposal of solutions.
▪ Transformation of the project from Java to Scala.
▪ Migration of the project to microservices from the old monolithic project.
▪ Data processing in Spark Scala.
▪ Application development.
▪ Application testing.
▪ Optimization of the application to consume fewer resources and run faster.
Scala Vert.x spark Elasticsearch java Docker Microservice MongoDB Jenkins