Oussama Debbou

Build "facility" files in ADRI format from selections of facilities and the fictitious facility selection file. Build "facility" files in ADRI format from selections of facilities and the fictitious facility selection file.

Skills: Python (programming language) · S3 · Bitbucket · PyCharm · JSON

Development of a data processing platform:

• Design and implementation of a robust data architecture to process large volumes of data in real-time from multiple internal and external data sources

• Implementation of a data storage strategy using distributed storage technologies such as Hadoop Distributed File System (HDFS) and Amazon S3

• Creation of ETL data pipelines to extract, transform, and load data into the platform from various data sources, such as databases, flat files, and APIs

• Use of Big Data technologies like Spark and Hive to process and analyze data at scale

• Optimization of platform performance using partitioning and load balancing techniquesDevelopment of a data processing platform: • Design and implementation of a robust data architecture to process large volumes of data in real-time from multiple internal and external data sources • Implementation of a data storage strategy using distributed storage technologies such as Hadoop Distributed File System (HDFS) and Amazon S3 • Creation of ETL data pipelines to extract, transform, and load data into the platform from various data sources, such as databases, flat files, and APIs • Use of Big Data technologies like Spark and Hive to process and analyze data at scale • Optimization of platform performance using partitioning and load balancing techniques

Skills: Spark · Hadoop · Agile methods · Python

Trainer responsible for upskilling user groups on Big Data technologies (Python, Scala, Hadoop, Spark, Hive, Hbase, Databases) and Dataviz (Tableau). Creation of an application aggregating various real-time salary and compensation trends from different job offer platforms (Pôle-emploi, Indeed, LinkedIn...etc.)

1 - CONSULTANT TRAINER:

- Definition of content and writing of training plans for various languages and tools

- Adaptation of the plan per user profile based on the required mastery level

- Facilitation of training sessions (sometimes up to 1 week) for various stakeholders (groups of about 20 people)

- Intervention on data science modules (assistance with user upskilling on technologies, explanations, practical case studies, and support if needed)

- Support for users in choosing their final project (feasibility study based on available completion time, stakeholder profiles...)

- Participation in the final project defense jury

2 - WEB AND DATA DEVELOPER:

- Constitution of source data: selection of different job platforms from which data is collected (via scraping)

- Definition of the application's real-time architecture

- Implementation of data ingestion pipelines via Python (pipeline development, ad hoc filter implementation...)

- Structuring and analysis of collected data in Datasets (profile, experience, salary) to identify compensation trends per profile

- Creation of visualizations using Matplotlib and formatting of Datasets

TOOLS / ENVIRONMENT:

MSZOOM,CLOUDERA,HADOOP,HBASE,HIVE,SPARK,PYTHON,SCALA,KAFKA,TABLEAU SOFTWARE,CASSANDRA,MONGODB,POSTGRES/MYSQL,PL/SQL