Freelancer profile translated to English.

Description

Lead Data Engineer with 10 years of experience in data, possessing a solid background in designing distributed data architectures, managing technical teams (data, BI, web), and implementing large-scale data processing pipelines (batch & streaming), performance optimization, and industrialization on Big Data platforms.

End-to-end intervention across the data lifecycle: scoping, architecture, development, performance optimization, industrialization, and operational maintenance. Strong ability to structure, secure, and leverage data, directly aligned with business objectives (industry, finance, banking, telecom).

Feel free to consult my profile to learn more about my experiences and skills. I would also be delighted to discuss your projects and needs.

My rate is negotiable depending on the mission.

Languages

English
Conversational
French
Native or bilingual

Workplace preferences

Can work on-site

Paris (up to 50km), Paris (up to 20km)

Société Générale
Lead Data Engineer
BANKING AND INSURANCE
February 2024 - Today (2 years and 6 months)
Fontenay-sous-Bois, France
Mission: Lead projects for mapping network flows and security rules, and certify application flows as part of strengthening cybersecurity against ransomware.

Main responsibilities:

Technical leadership and supervision of a multidisciplinary team (Data Engineers, BI Engineers, Web Developers).
Definition and arbitration of data and application architecture choices, implementation of development best practices, optimization of Spark performance, scheduling, and storage on the Cloudera platform.
Data modeling design, technical documentation writing, and implementation of data and application governance with role management.
Team support through peer programming, code reviews, technical support, and production incident resolution.
Guaranteeing the consistency and interoperability of collection, ingestion, mapping, and certification modules, aligned with business needs.
Optimizing the Lucid → Trino → MicroStrategy decision chain to improve performance and user experience.
Leading projects using Agile methodology: requirements gathering, facilitating scoping workshops, prioritization, roadmap management, tracking workload, velocity, milestones, and delivery, with coordination of business and technical teams and facilitating Agile ceremonies.
Design and implementation of batch and streaming ingestion pipelines (repositories, firewall logs, network flows), data enrichment to produce a technical and functional map of flows, optimization of Hive/HDFS data quality, and orchestration of processing via Control-M.
Spark structured streaming Spark sql Hadoop Startburst Elasticsearch
BNP Paribas
Lead Data Engineer
BANKING AND INSURANCE
June 2022 - Today (4 years and 1 month)
Montreuil, France
Mission: Co-construction of Data service offerings on the BNP Paribas private cloud (IBM Cloud), support/coaching of applications on datahub V1 (Hadoop), and support for migration solutions to BCEF.

Achievements:
- Supporting project teams on technical solutions and production incidents
- Implementing a testing pipeline for datahubV2 services (Starburst, Hive, Airflow) via Behave Python, Jenkins, Docker, and Octane
- Conducting POCs and MVPs on Starburst based on datahubV1a use cases
- Conducting POCs and MVPs on Iceberg and coupling with Starburst and Spark
- Data federation on Starburst
- Optimizing Hive/Hdfs data quality
- Developing a module for collecting and producing data in batch and streaming mode from Kafka to Teradata
- Migrating data from Kafka Confluent to IBM EventStream
- Participating in the implementation of data governance in datahubV2
- Code review, Git validation
- Implementing good application practices
starburst Kafka confluent Ibm EventStream Hive Airflow
Société Générale
Lead Data Engineer
BANKING AND INSURANCE
April 2021 - June 2023 (2 years and 2 months)
Puteaux, France
Summary: CARMA project on data compliance from various entities.

Achievements:
- Supporting data engineers (coordination and monitoring of data projects)
- Code review, Git validation
- Development of CI/CD pipelines (Git, Cucumber, Jenkins, Ansible)
- Implementation of streaming data collection pipelines
- Implementation of batch and streaming data collection and processing pipelines (Scala Spark and streaming mode (Nifi, Kafka, Elk))
- Data storage on various components meeting diverse needs: Hive, PostgreSQL (BI & analytics), Elasticsearch (Search engine, monitoring), S3 (Palantir)
- Scheduling of execution flows (Spark jobs, HiveQL) on Oozie
- Optimization of Spark jobs and Nifi workflow
- Implementation of good application practices
Spark Nifi Ansible AWS S3 Elasticsearch