Freelancer profile translated to English.

Description

With several years of experience in data engineering, I have had the opportunity to work for major clients such as La Poste and Société Générale on demanding Big Data projects. My expertise focuses on managing large volumes of data and implementing complex processing to meet critical business needs.

I master a wide range of technologies and programming languages, including Spark, Scala, Databricks, Hadoop, Kafka, SQL, Cloudera, and Kubernetes. My approach is performance and optimization oriented, with solid experience in production environments.

Passionate about data-related challenges, I am ready to support you in the realization of your projects, from architecture to the implementation of innovative solutions.

Languages

French
Native or bilingual
English
Fluent
Arabic
Native or bilingual

Workplace preferences

Can work on-site

Paris (up to 50km)

laposte
Senior Data Engineer
June 2021 - Today (5 years)
Issy-les-Moulineaux, France
**Context**: As part of La Poste's digital branch Data Lake project, our team is responsible for the design & implementation of generic and reusable jobs and workflows for business teams, as well as integrating new hot (Streaming) and cold (Batch) data sources.
Tasks performed:
Ingestion tool development: Design and implement tools for ingesting data in various formats (CSV, JSON, Avro, etc.).
Data consolidation: Develop a tool for efficient data consolidation. Data privacy: Implement a tool for anonymizing and encrypting sensitive data to ensure confidentiality.
Component migration: Migrate critical components such as Spark and Kafka to the future CDP (Cloudera Data Platform).
Optimization: Tune and optimize jobs and workflows for increased performance. Mentoring: Mentor and train team members to ensure proper use of the implemented tools and processes.
Production monitoring: Ensure monitoring and maintenance of solutions in production.
Technical environment:Ecosystem (Openshift and CDP), Scala, AKKA, Python, Spark, Hive, Confluent Kafka, Airflow, Docker, Jenkins, Ansible
Société Générale
Data Engineer
November 2018 - May 2021 (2 years and 7 months)
Paris, France
**Context**: The project aimed to consolidate data for legal entities (PM) and individuals (PP) and create a web interface offering a 360° view of third parties.
Tasks performed:
Data consolidation: Development of a tool to consolidate data for individuals and legal entities from different sources.
Business view engine: Implementation of an engine to generate specific views meeting business needs.
Matching tool: Development of a tool for matching and validating data flows.
Data storage: Persistence of consolidated data in MongoDB and search data in ElasticSearch for fast and scalable management.
Development of ingestion pipelines: Creation of ingestion pipelines (batch and stream) from different data sources using Oozie/
Spark Connectors: Development of ingestion connectors to process CSV, XML, and JSON formats.
Maintenance and support: Maintenance and support of various pipelines, including production incident management.
Performance indicators: Define KPIs to measure the performance of ingestion pipelines.
Technical environment:Hadoop (Hortonworks, Cloudera), Spark/Scala, Hive, Kafka, ElasticSearch, MongoDB, AngularJS, Node.js, REST API, Docker, Jenkins, Amazon S3, Ansible
Carrefour
Symfony Consultant
August 2018 - October 2018 (3 months)
Massy, France
**Context**: Development and improvement of a payment server for Carrefour, based on the existing solution from Rue du Commerce. The objective was to create a reusable platform for the Carrefour group, while adding specific features to enhance the user and commercial experience.
Tasks performed:
Payment server study: In-depth analysis of the existing payment server at Rue du Commerce to understand its functionality and specificities.
Code factorization: Refactor the code to make the solution reusable and adaptable for Carrefour.
Addition of new features:
- Integration of the purchase option with loyalty points for certain products.
- Development of an option allowing sales agents to place orders in a simplified manner.
API documentation: Write detailed API documentation using Swagger to facilitate its use and maintenance.
Bug fixing: Resolve identified anomalies to ensure the platform's stability and performance.
Technical environment:PHP 7, Docker, Docker-Compose, MongoDB, Composer, PhpUnit, REST API, JSON, Swagger.