Freelancer profile translated to English.

Description

Senior Data Engineer with extensive expertise in designing, developing, and implementing large-scale data pipelines. Strong skills in data engineering, data architecture, and Big Data technologies such as Hadoop, Spark/Scala, Nifi, and CI/CD. Proven experience in team management and project leadership, with a demonstrated ability to transform business needs into effective technological solutions. In-depth technical skills combined with a strategic orientation to optimize data flows and maximize business value. Strong commitment to data quality, security, and compliance throughout the project lifecycle.

Industry field of expertise

Languages

French
Native or bilingual
English
Fluent
Arabic
Native or bilingual
Spanish
Basic

Workplace preferences

Can work on-site

Paris (up to 50km)

LCL
DATA Referent & Senior Data Engineer
BANKING AND INSURANCE
November 2024 - Today (1 year and 7 months)
Paris, France
Project at LCL: Transversal intervention and within the Finance & Operational Risks squad to optimize Big Data flows. Contribution to process evolution on Teradata, Datastage, and an internal framework, with a focus on performance and industrialization.
Missions:
Analysis and needs assessment.
Writing detailed technical specifications.
Supporting business squads (Finance & Operational Risks) in data management and exploitation.
Solution design and development.
Conducting unit tests and supporting acceptance testing.
Deployment via GIT.
Managing deliverable versions with GIT.
Developing backup processes on AWS S3.
Participation in the evolution of the technical foundation and architecture.
Contribution to the improvement and evolution of the technical foundation and architecture.
Creating automated scripts to simplify common administration tasks.
Configuring workflows using Control M.
Managing performance and optimizing SQL queries.
Participation in the review of roles and profiles for each squad.
Monitoring and managing storage space in the HDFS file system.
Designing and optimizing complex SQL queries in Teradata.
Integrating data from different sources (Mainframe + API) into Hive.
Implementing data ingestion, validation, cross-referencing, and delivery chains.
Decommissioning of Datastage.
Ensuring version maintenance.
Involvement in all project phases.
Attending various Agile ceremonies (Daily meeting / Retro/ Review / Sprint planning).
Mentoring and supporting the skill development of new joiners.
Supporting business users in their activities.
Managing N2/N3 incidents and anomalies using Jira.
Writing documentation on Confluence.
Creating a welcome booklet for new joiners.
Teradata AWS S3 Big Data Gitlab CI/CD Script Shell
Sofrecom Services
Senior Data Engineer
TELECOMMUNICATIONS
February 2022 - October 2024 (2 years and 8 months)
Paris, France
B2B EDH ORANGE Project: Platform for Orange France's B2B Big Data program, enabling customer relationship management, strategy definition, and market and distribution development.
Missions:
Needs analysis and assessment.
Writing detailed technical specifications.
Assisting Data Analysts in identifying business rules.
Solution design and development with Scala Spark.
Conducting unit tests and supporting acceptance testing.
Deployment via Jenkins and GIT.
Developing backup processes on AWS S3.
Configuring and managing complex workflows using Oozie.
SQL query optimization.
Migrating complex HQL scripts to Scala Spark.
Monitoring and managing storage space in the HDFS file system.
Designing and optimizing complex SQL queries in Hive.
Implementing data ingestion, validation, cross-referencing, and delivery chains.
Contribution to a project migrating existing data pipelines to Databricks, including adapting Spark processes, managing notebooks, and optimizing performance on the platform.
Setting up a modern data warehouse on Databricks (Delta Lake) to centralize and historize business data.
Developing streaming pipelines with Databricks Structured Streaming for real-time ingestion and processing (Order Domain).
Involvement in all project phases.
Attending various Agile ceremonies.
Mentoring and supporting the skill development of new joiners.
Conducting training sessions within the C2S center.
Managing N2/N3 incidents and anomalies using Jira.
Writing documentation on Confluence.

Technical Environment:
Scala, Hive, Apache Spark, Agile methodologies, Databricks, Yarn, Big Data, SHELL scripting, Oozie, Jenkins, HQL, SQL, Tortoise GIT, CI/CD, AWS S3, NIFI, Fast, JIRA, Confluence.
Scala Spark Hadoop CI/CD HQL
Sofrecom Services
Data Engineer
TELECOMMUNICATIONS
August 2018 - February 2022 (3 years and 7 months)
Casablanca, Morocco
BI-Mobile ORANGE Project - BUILD Team -: Management of all Orange France Mobile data, one of the largest Data Warehouse operations in Europe.

Missions:
Needs analysis and assessment.
Writing detailed functional and technical specifications.
Writing interface contracts.
Solution design and development.
Conducting unit tests and supporting acceptance testing.
Managing deliverable versions with TortoiseSVN / GIT.
Ensuring version maintenance for 3 months.
Involvement in all project phases.
Leading various Agile ceremonies (Daily meeting / Retro/ Review / Sprint planning).
Supporting the skill development of new recruits.
Supporting business and IT departments in their activities.
Team spokesperson for support teams.
Managing production versions and preparing for production deployment.

Projects:
Creation of several outgoing interfaces from the BI-Mobile foundation and business views (CIFRA, EPILOG, EWOCS..). [TERADATA V14]
Reuse Orders BIM: Redesign of the BI-Mobile order foundation; I participated from the design phase to the development of the foundation and the various business views. [TERADATA V16]
WelcomeSMS Project: Creation of a new ODS with a Framework based on SHELL scripts for its maintenance and management.

Technical Environment:
SQL, Advanced SQL, SHELL scripting, Dollar Univers, TERADATA V14 and V16, Putty, Tortoise SVN and GIT, JIRA, TERADATA Utilities (FASTLoad, MultiLoad, TPump, FASTExport).
Teradata Gitlab CI/CD Script Shell SQL Esprit d'analyse et de synthèse