Freelancer profile translated to English.
Back to original languageAbout Abderrahmane
With 8 years of IT experience, including 6 in Data Engineering, I design and deploy robust and scalable data pipelines, transforming raw data into strategic insights. My expertise covers data ingestion, transformation, storage, and visualization, using cloud and big data technologies.
I am involved in all stages of a project, from design to development and industrialization.
I collaborate closely with business teams to understand their needs and provide tailored solutions, while ensuring the performance, scalability, and reliability of the implemented systems.
Throughout my experiences, I have developed expertise in cloud and Big Data technologies. My primary expertise is in various GCP technologies (Bigquery, Dataproc, Cloud Composer GCS) and Spark (Pyspark/Scala).
French
Native or bilingual
English
Native or bilingual
Can work on-site
Paris (up to 30km)
Experience
- BPCEData EngineerBANKING AND INSURANCEMarch 2023 - December 2025 (2 years and 9 months)Charenton-le-Pont, FranceBarometer / Finance Project– Development of pipelines to process over 20 million credit card transactions.– Ingestion of CSV/XLSX data and external databases.– Transformation and modeling with Spark Scala, Starlake.ai, and BigQuery.– Partitioned data storage in Parquet on GCS.– Automation of ingestion and transformation processes with Cloud Composer (Airflow).– Automation of transfers to Azure Blob via Control-M.– Creation of analytical cubes in Azure Synapse to feed Power BI for visualization.– Active participation in the CI/CD pipeline: deployments, tests, and production.
- Informatique CDCData Engineer ConsultantDIGITAL AND ITOctober 2021 - December 2022 (1 year and 3 months)Arcueil, FranceDataRisk:- Extraction of data from various sources (csv, excel, sql, kafka).- Creation of the Kafka ingestor;- Data qualification and creation of different datamarts.- Deployment and CI/CD management across different environments.- Migration of components/applications from HDP Hortonworks to CDP Cloudera. Technical environment: Hadoop (hortonworks/cloudera), PySpark, SparkSql, Kafka, Hive (dbeaver), BitBucket, Jenkins, SonarCube.
- ENEDIS (Ex ERDF)Data EngineerENERGY AND UTILITIESSeptember 2020 - September 2021 (1 year and 1 month)ODDR:- Development of a product for ingestion into the centralized datalake.- Data collection.- Qualification according to business specifications.- Availability on Hive and PowerBI.- Tuning and optimization of Spark jobs.- Automation and scheduling of jobs. Technical Environment: Hadoop (Hue), Spark, Scala, Hive, Hbase, Sqoop, SparkSql, Denodo, PowerBI, Agile Scrum.
Recommendations
Be the first to recommend Abderrahmane
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Master Big Data and Data MiningUniversité Paris 82019Master's degree, Big Data and Datascience
- Master Intelligent Systems and Artificial IntelligenceUniversité des Sciences et de la Technologie 'Houari Boumediène'2016
Certifications
- Professional Data EngineerGoogle Cloud Platform
- CRT020: Databricks Certified Associate Spark DeveloperDatabricks