REFreelancer profile translated to English.
Back to original languageAbout Rachid
Passionate about data, I have over ten years of experience in software engineering and data engineering.
I participated in the implementation of data platforms on cloud and on-premise, particularly on Cloudera, HortonWorks, GCP, Azure (Synapse, Data Factory).
French
Native or bilingual
Can work on-site
Paris (up to 50km)
Experience
- CandriamSenior Data EngineerPRIVATE EQUITYSeptember 2024 - Today (1 year and 9 months)Paris, FranceRedesign of the analytics platform: Migration from Informatica to Synapse• Implementation of a PySpark ingestion framework based on metadata.• Implementation of a Data Quality framework.• Design and implementation of data ingestion, transformation, and loading pipelines in the medallion architecture.• Development of data APIs using FastAPI.• Design and implementation of a testing framework: multi-comparison of different data sources.• Environment: Azure Synapse, Azure Pipelines, Pyspark, Delta format, Azure Data Lake, Azure Table Storage, Azure DevOps, FastAPI.
- Crédit AgricoleData Engineer: DataLakePRIVATE EQUITYNovember 2021 - June 2023 (1 year and 7 months)Paris, France• Maintenance of the datalake on MapR: Hive, Hadoop, Sqoop, Tez, Hue, Oozie, PySpark.• Development of data ingestion, transformation, and exposure jobs.• Migration: design and implementation of a new datalake: data zones, ingestion processes.• Translation of SQL scripts in Hive to Oracle SQL• Generation of ODI objects (Interfaces, Processes, Scenarios) via Python scripts.• Automation of acceptance testing: validation of tables (schemas, columns, types), views.• Containerization of the Cash In Time application using Kubernetes and ArgoCD.• Implementation of CI/CD pipelines for source code deployment.• Environment: PySpark, Hive, Sqoop, Pandera, Pydantic, Tez, Hue, Oozie, Jenkins, Docker, ArgoCD, Kubernetes, GitLab, Oracle ODI, Oracle Database 19c.
- Informatique CDCSenior Data EngineerPRIVATE EQUITYAugust 2023 - September 2024 (1 year and 1 month)Paris, FranceImplementation of data bricks for various business use cases• Design and implementation of use cases: structure, CI/CD chain, PySpark job.• Implementation of development best practices: CI/CD, TNR, TU, GitFlow.• Data Vault modeling: ingestion zones, pre-processing, and datamarts.• Development of data ingestion, pre-processing, and exposure jobs.• Integration of external data via Kafka batches: ratings, third-party risks, Bloomberg.• Environment: Cloudera, Hive, Spark, PySpark, Python, Kafka, PyTest, Pydantic, Jenkins, Bitbucket, Control-M.
Recommendations
Be the first to recommend Rachid
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Cloud Certified Data EngineerGoogleCloud Certified Data Engineer
- Credential ID: HPWFGh MongoDB Certified DBACredential ID: HPWFGh MongoDB Certified DBA