Abdellah Mezar

Objectives:Design and development of a POC for populating an open Data Lakehouse using the latest technologies (Apache Airflow, Apache Spark, NoSQL, Hive, DBT, MINIO, AWS etc.) to meet the company's requirements (Internal AI Data Project)

• Implementation of data ingestion and integration pipelines from MySQL Server

• Case study of data integration from various sources while ensuring data quality and consistency.

• User Support and facilitation of work sessions

• Incident Management (ITSM), (Jira)

• Participation in the implementation of the CI/CD chain via Jenkins

• Monitoring of the DB server activity via Grafana

• Optimization of SQL queries and analysis of execution plans

• MySQL Server

• Postgres

• Apache Airflow

• Apache Spark

• Trino SQL querying ⋅ HiveMetastore

• MINIO OBJECT STORE (similar to AWS S3)

• OS: Windows, UNIX

• Scheduler: Airflow

• Ticketing tools: Jira, Darwin, ITSM

Objectives:Management of two decision-making platforms (Talend and SAP BI4). My mission was to carry out maintenance and various evolutions on the Talend and SAP BI4 platforms.

• Administration of the Talend platform via TAC and SAP BI4 via CMC

• Monitoring of the platform's service status (saturation, restart, production monitoring, etc.)

• User Support and facilitation of work sessions (Talend Development Team) – 380 users

• SAP BI4 User Support (Development Team, Business Team) – 1000 users

• Incident Management (ITSM), Business requests (Jira)

• Participation in the implementation of the CI/CD chain via Jenkins and Ansible

• Regular exchange with vendors on various complex topics

• Participation in the migration of Talend projects from 5.3 to 7.3 and 8.0

• Monitoring of the DB server activity via Grafana

• Optimization of SQL queries and analysis of execution plans

• Optimization of stored procedures

• Table partitioning Performance monitoring (KPI), reporting and data analysis (DigDash)

• SQL Server 2014

• Java 8, 11 & 17

• Talend Integration Suite 5.3 & 7.3

• DigDash API

• Business Objects 4.2

• Tableau Software

• OS: Windows, UNIX

• Scheduler: Control_M

• Ticketing tools: Jira, Darwin, ITSM

• DevOps: Jenkins, Bitbucket, GitHub, CI/CD

Context:Application for all BNP group employees (internationally)

2 purposes:

- Provide employees with training (in-person, e-learning) based on their profile and collected data

- Publish job offers (internal mobility) for targeted audiences based on their profile (function, geographic area, experience level, tech, etc.)

My presence within the Data team focused on several aspects.

- Collection, analysis, and interpretation of data sets to provide actionable insights to the Business.

- Management and improvement of data quality, development of ETL pipelines to ensure data consistency and enable Data Scientists to create reports and dashboards, with the aim of facilitating decision-making.

• Acquisition and storage of data streams via CFT transfers

• Development, deployment, and monitoring of Big Data solutions for the HR department (Hadoop, Spark-scala, Hive, Dataiku)

• Verification and evaluation of workflows

• Creation of matching scripts between employees and job/training offers

• Construction and delivery of projects in DataHub, DataLake, and Dataviz

• Implementation of new data streams and creation of data ingestion scripts

• Ingestion of a variety of data sources and indexing with Solr

• Implementation of versioning for components (Spark, HDP, JRE)

• Monitoring and execution of production deployments with the production teams

• Participation in the enrichment of technical documentation

• Implementation of short- and medium-term corrective actions

• Participation in the migration from HDP 2.6 to CDP 7.

• Horton Works HDP 2.6 (Ambari, Ranger, Hadoop, Hue) migration to CDP v.7

• DevOps Platform CI/CD, Spark-Scala, GitLab, HQL, Dataiku