Freelancer profile translated to English.

Description

Data Engineer with 8 years of experience, I design and optimize scalable data pipelines on Databricks, leveraging PySpark, dbt, and AWS services (S3, Lambda, etc.). I am involved in all stages of the data lifecycle: ingestion, transformation, and exposure of datamarts for advanced analytics.

I also master Palantir Foundry for pipeline design via Pipeline Builder, data lineage management, and data connection configuration, thus ensuring the traceability and reliability of data flows.

✅ Expertise in Spark, Databricks, and dbt

✅ Design and optimization of pipelines on Palantir Foundry (Pipeline Builder, Data Lineage, Data Connections)

✅ Cost and performance optimization on the cloud

✅ Automation and industrialization of data flows

✅ Azure DevOps

✅ Experience in migration and management of Databricks workspaces

Certified Databricks Data Engineer Professional ✅

AWS Solutions Architect ✅

dbt Fundamentals ✅

I am available to support you in your data projects, whether it's setting up optimized architectures, improving your existing pipelines, or reducing your costs on Databricks and Foundry.

Languages

French
Native or bilingual
English
Fluent
Arabic
Native or bilingual

Workplace preferences

Remote only

Primarily works remotely

TotalEnergies
Tech Lead Data
ENERGY AND UTILITIES
July 2025 - Today (11 months)
Paris, France
As a Data Tech Lead, I drive the design and implementation of data solutions on a Databricks-based platform, ensuring the robustness, scalability, and quality of processing.
I develop and supervise data pipelines using PySpark and dbt, covering the entire data lifecycle, from ingestion to datamart availability.
I implement development and industrialization best practices via Azure DevOps (CI/CD, version control, deployment automation), while ensuring code quality and maintainability.
I also work on industrial data integration via Cognite Data Fusion, setting up centralized monitoring between Cognite extractors and Databricks processing, to ensure reliability, traceability, and production flow monitoring.
In parallel, I contribute to data valorization through the creation of dashboards with Power BI, in collaboration with business teams.
Finally, I play a key role in architectural choices, technical team support, and continuous improvement of data practices.
Databricks DBT Apache Spark Cognite Azure DevOps
engie
Tech Lead Data
ENERGY AND UTILITIES
March 2023 - July 2025 (2 years and 4 months)
Courbevoie, France
Migration of Cloudera processing to Databricks
Automatically provide data in the Databricks platform
Automate integration processes and ETLs using Databricks Workflow and Airflow
Maintain and optimize existing processing (dual run for one quarter)
Evolve the data model to best meet user needs
Monitor all platform services (availability, integration tracking, quality tracking, consumption tracking, etc.).
Manage S3 storage, archiving, and backup in S3 Iceberg.
Decommissioning of the Cloudera platform after a quarter of dual run
Realization and automation of a backup of the entire Databricks workspace in S3.
Participation in the development of the internal chatbot that answers FAQ needs
Extraction of data from PDFs, and vectorization of data to feed the internal chatbot model
Development of automatic deployment in GitHub Actions.
Creation of a dashboard on Databricks and Power BI to facilitate the search for ingested data flows and sources
Technical environment: Airflow, GitHub, Git, Pyspark, Ambari, Hue, SqlServer, Jira, Confluence, S3, AWS, Databricks, Cloudera Enterprise, Power BI, Databricks
Palantir Foundry: integrate data from Databricks in direct connection mode using agents and virtual tables.
Participation in setting up the system ontology
Migration of gold jobs from Databricks to Palantir using Pipeline Builder
Palantir Foundry PySpark AWS S3 Databricks DBT
bnpparibas
Tech Lead Data
BANKING AND INSURANCE
January 2023 - March 2024 (1 year and 2 months)
Redesign of the IRB Africa sites' Information System for Customer and Account Reference Data
▪ Alignment of the Atlas2 information system for the production of regulatory reports as defined by BCEAO via the new Carthago platform.
▪ Pooling of Africa region information systems:
▪ Convergence of the various ATLAS information systems of the subsidiaries into a single standard managed on a single machine for project pooling and cost reduction.
▪ Migration of monthly account closings to daily closings for the Africa region:
▪ Deployment of the daily account closing calculation process, elaboration of management reports, and database cleansing.
▪ Implementation of accrued interest for the account closing module:
▪ Evolution of the accounting schemas for the reversal of accrued interest and batches so that the accrued interest is automatically generated by the Closings chain during the next closing's accounting.
▪ Deployment of the sub-balances module for general accounts in the Africa region:
▪ Implementation of a new "SUB-BALANCES" concept within the general accounts module, enabling the reliability and fluidity of accounting and financial site reporting.
▪ Deployment of cash vouchers and term advances.
▪ Deployment of new term deposit products for sites: New Caledonia
▪ Migration of ATLAS SAB for OM sites: creation of autosys boxes for each site
▪ Creation of a data dictionary for compliance for Reunion and ZAG
▪ Evolution of the OM customer object: Addition of the calculation of new indicators to detect fragile customers
▪ Decommissioning of overseas and Algerian sites and ensuring smooth handover to developers (in progress)

Technical Environment: Autosys, Jenkins, Git, Spark/Scala, Ambari, Hue, SqlServer, Jira, Confluence.
Cloudera Spark Scala Autosys Jenkins Databricks