Freelancer profile translated to English.

Description

I am looking for a data engineering mission where I can leverage my expertise while taking on new technical and business challenges ;)

Curious and autonomous, I am not afraid to embrace new technologies or explore new business areas!

My professional experience covers:

- ETL: Nifi, Talend, Genio (OpenText Otic), and soon DBT

- Dev languages: Scala, Java, Groovy, Bash, and of course intensive use of SQL (BigQuery, Oracle, etc.)

- Frameworks: Kafka Streams, Spark, Spring

I primarily work in a GCP environment: BigQuery, BigTable, GCS, Pub/Sub, Dataproc, GKE for deployment.

I have had the opportunity to develop and deploy data pipelines:

- streaming (Kafka, Pub/Sub, RabbitMQ)

- batch (Spark on Dataproc, BigQuery, Google API, BigTable, ETL mentioned above)

I also make this data available via REST APIs, developed with Spring MVC or Scalatra, with BigTable or ElasticSearch backends.

Industry field of expertise

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Paris (up to 50km), Dijon (up to 10km)

Carrefour
Data Engineer
RETAIL (LARGE RETAILERS)
June 2023 - Today (3 years)
Massy, France
Subcontracting via Alteca

Implemented Java and Scala applications for Carrefour's DataLake within the scope of sales prices, offerings, e-commerce, and several other repositories.
Scrum Master (1 year) + Onboarding of newcomers
Evolution of the existing architecture, Scoping and technical design of business needs
Development, installation of business needs, and then maintenance of production applications within the team's scope
Evolution of the Data platform's technical foundation

Some projects I actively participated in:

Sales Prices (Live): Calculation of active sales prices per item, store, service
Evolutionary and technical maintenance of active sales price exposure
Complete reconstruction of the active price state considering 28 billion historical prices, 16TB of data
Applications capable of processing 100k messages/second at peak
Java Spring MVC API exposure with BigTable Backend

E-commerce Sales Price Calculation: Batch calculation of sales prices to be exposed on carrefour.fr
Structuring evolution in Carrefour's sales price calculation, considering multiple price sources
Complete analysis of impacts and discrepancies on over 300 million lines generated by the calculation.
Calculation of Orderable Assortment: Calculation of product orderability for each store, logistic unit by Carrefour customers
Migration of Carrefour's offering calculation from Spark -> BigQuery
Design of an orderability period construction from 4 different assortment sources in SQL
Implementation of new requirements in the calculation algorithm (old and new)
1 million lines generated daily

Tech: Scala, Java, Kafka Streams, Spark, SQL (BigQuery), Google Cloud Platform, GKE
Java Scala Apache Spark Apache Kafka Google Cloud Platform (GCP)
Belambra
Data Engineer
ENTERTAINMENT AND LEISURE
October 2022 - June 2023 (9 months)
91300 Massy, France
Permanent contract Alteca

Scoping and implementation of new business requirements through Genio (OTIC) and Oracle corresponding to Belambra's operations (booking and management of stays/holidays)

Reverse-engineered and mapped the Data Warehouse by analyzing ETL flows to build complete documentation and data lineage.

Implemented and automated structuring evolutions related to key changes throughout the Data Warehouse to enable migration to their new booking tool. Impact: 100+ table and file schemas and their constraints.

Participated in the migration from Genio to Talend.

Tech: Talend DI, Genio, Groovy, Java, Shell, Powershell
Talend ETL Talend DI OTIC Genio SQL
JCDecaux
Data Engineer
October 2022 - April 2023 (6 months)
Massy, France
Permanent contract Alteca

Design and implementation of the Genio to Talend migration - Reverse engineering and reconstruction of specifications from code.

Tech: Talend DI, Genio, Java
Java Talend ETL Talend DI Genio OTIC