Abderrazak Moudden

As part of the Datalake and Dataware projects, I mainly worked on batch processes to centralize and integrate data from different regional branches. This involved using Hive tables from the Datalake and Oracle tables fed via Kafka Connect, on which I applied business rules before integrating them into a Group Data Warehouse (DWG) Oracle. This data is then used for indicator calculations via Informatica ETL and visualized in Qlik View, to serve various back-office functions, including decision support, fraud detection, anti-money laundering, as well as for the creation of payment rate and rejection management indicators.

Design and implementation of data ingestion pipelines

· Maintenance and improvement of Spark jobs with Scala, including optimization of processing times

· Development of data extraction and integration jobs between Hive and Oracle

· Development and optimization of Hive queries for efficient data analysis

· Management and organization of data and files on HDFS

· Creation and execution of unit and integration tests with ScalaTest to ensure quality and non-regression

· Implementation of evolutionary schema changes and technical documentation

· Data analysis and visualization

· Writing general and detailed functional specifications

· Implementation of a data comparison utility with statistics (Comparator)

· Conducting code reviews and monitoring developments

· Analysis of the existing system, impact studies and estimation of evolutions

Participation in the evolution of projects aimed at providing the operational monitoring indicators necessary for managing the parcel delivery activity at the "La Poste Colissimo" client site.

Design and development of a VAT calculation system using Spark, Kafka, and PostgreSQL.

Design and participation in the architecture of applications from scratch

Development of CQRS microservices with Spark and Akka Stream (Command part) and Play Framework and Akka Http (Query part).

Design and development of a message sorting, injection, and generation system using Spark and Kafka.

Contribution to the technical and functional mentoring of new team members

POCs realization

Application bug fixes and evolutions

Study and analysis of the existing system

Participation in technical and functional design workshops

Data integration and transformation

Performance testing realization

Writing of explanatory summary documents

Technical documentation

Support for testing teams