About Mahdi
- Cloud: GCP, AWS
- Big Data: Cloud Function, Pub/Sub, Cloud Composer, GCS, BigQuery, Dataflow, Cloud Build, Workflow, AWS ECS, S3 bucket, ECR, AWS Lambda Function, Apache Spark, Hadoop, HDFS, Hive, Hbase, Apache Kafka, Apache Storm,
- DevOps and IaC: Jenkins, Groovy, Ansible, Terraform, OpenShift, Docker, Nexus, CI/CD pipelines, Bitbucket, GitHub, GitLab
- Programming Languages: Python, Java, Scala, JavaScript/TypeScript
- Databases: SQL Server, PostgreSQL, MySQL, Oracle Database, MongoDB, Cassandra, Hbase
- Machine Learning / Data Mining: Python , LLM
- Frameworks: J2EE, NexJS, Laravel, NuxtJS, React Native, Tailwind.
- Methodologies: Agile (Scrum, Kanban), Microservices, XP (TDD, Pair Programming, Code Review)
Arabic
Native or bilingual
English
Fluent
French
Fluent
Spanish
Basic
Experience
- BPCE Payments ServicesSenior Cloud Data EngineerBANKING AND INSURANCEMay 2023 - Today (3 years)Paris, FranceAt BPCE as a Senior Cloud Data Engineer since June 2023, I primarily work on a project called Data Factory. My role involves designing and developing data pipelines in an industrialized environment, processing massive data volumes (several terabytes) related to customer databases, mainly on BigQuery using SQL stored procedures.My main responsibilities include:
- Pipeline Development: Using Spark, Scala, and Cloud Composer to create and optimize data flows.
- Workflow Automation: Implementing workflows via Apache Airflow to automate data processes.
- Cloud Infrastructure: Utilizing Terraform to deploy and manage resources on Google Cloud Platform (GCP), ensuring a scalable and robust environment.
- Technologies Used: Apache Airflow, Spark, Scala, Python, SQL, GCP (BigQuery, Composer, Cloud Scheduler, Cloud Function, Cloud Build, Pub/Sub), Terraform, Bitbucket.
This position requires strong technical expertise and the ability to collaborate with different teams to deliver robust and high-performing data solutions. - L'Oréal SA - L'Oréal FranceCloud Data EngineerFASHION AND COSMETICSMay 2022 - May 2023 (1 year)Clichy, FranceWithin the Compass Project with the Finance teams. L'Oréal's financial reports contain data on their global sales, as well as detailed sales figures by product category, geographic region, and sales channel (e.g., retail stores, online sales). The mission consists of (using GCP) collecting and storing this sales data in batch or streaming, cleaning and transforming this data, and ingesting it into BigQuery for analysis and availability to BI teams.
- LCLData EngineerBANKING AND INSURANCEApril 2021 - May 2022 (1 year and 1 month)Paris, FranceWithin the DAP Project using customer, transaction, and credit data. This involves collecting, storing, processing, securing, and modeling data to support data analysis and decision-making. I worked closely with data analysis teams to ensure data is used effectively to improve LCL's operations and provide quality banking services to its customers.
Recommendations
Be the first to recommend Mahdi
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Master 2 Data ScienceUniversité Claude Bernard Lyon 1-INSA-ECL2018
- State Engineer in Computer ScienceEcole Nationale Supérieure d'Informatique ESI ex INI Alger2017Option: Systèmes Informatiques
Certifications
- Google Cloud Certified Professional Data EngineerGoogle2023
- HashiCorp Certified: Terraform Associate (002)HashiCorp2023