Freelancer profile translated to English.

Description

8+ years of experience in data engineering on Big Data environments (Spark / Scala / Hadoop / Cloud), with a technical reference role on industrial data platforms (banking, transport, retail). Specialized in the design of generic frameworks, the industrialization of processing and the quality of data for business steering.

Languages

French
Native or bilingual
English
Native or bilingual
Arabic
Native or bilingual

Workplace preferences

Can work on-site

Paris (up to 50km)

RATP
Senior Data Engineer
TRANSPORTATION
February 2025 - Today (1 year and 4 months)
Paris, France
Modernization of maintenance steering (GMAO Magellan/Maximo – MRF Directorate).
• Design and development of a generic Bronze→Silver ingestion framework (Spark/Scala) for 60+ Magellan collections, driven by configuration files.
• Implementation of the Diamond layer: modeling of fact and dimension tables, construction of business timelines (interventions, resources, processes, lines, teams).
• Development of business pipelines (enriched interventions, theoretical/actual hours, resources, materials) feeding maintenance performance KPIs (IPR / ISE).
• Industrialization of processing with Delta Lake (merge, partitioning, optimization, vacuum) and orchestration via DBX Jobs / Asset Bundles.
• Contribution to data exposure to Power BI and support for BI teams on the use of Diamond tables.

Technical environments: Databricks, AWS, Spark/Scala, Delta Lake, Giltab, Terraform, Power BI.
Databricks Scala Spark Terraform Cloud AWS
Natixis
Data Engineer Reference – Spark Scala Front Office Desk Pricing Services
January 2023 - December 2024 (1 year and 11 months)
Paris, France
• Management of the Quantitative team.
• Development and integration of APIs
• Intervention in the improvement and maintenance of the IEES API for XVA calculation.
• Development and integration of .Net APIs for managing settings and market data
• Development of an advanced tool for XVA calculation based on the DATASYNAPSE calculation grid
• Automation of the import of market data essential for XVA calculation via .NET APIs
Scala Spark datasynapse singlestore Power BI Desktop
Carrefour
Data Engineer Spark Scala
April 2022 - December 2022 (8 months)
• Contribution to the PHENIX program for centralizing group data in a data lake with a real-time view of activity.
• Integration of data into the GCP data platform and implementation of integration monitoring
• Development of connectors based on REST APIs for data ingestion.
• Participation in BigQuery modeling and analysis of result anomalies.
• Development of business functionalities in agile mode (Scrum): extraction, transformation, calculation of indicators, exposure via REST API.