Mohamed LAMOUCHI

Improvement of the current data architecture

- Change in partitioning of cooked data, from functional partitioning to technical partitioning

- Implementation of scheduling with Nifi instead of Oozie

- Creation of NIFI templates for launching collection, ingestion, and algorithm processing

- Study of the use of Drill as a data connector on the platform from other applications

- Study and POC for the use of Hbase on the platform.

- POC on Flume

Improvement of Hive database access performance

- Study of the use of Drill as a connector and accelerator for the Hive database

- Expand the use of LLAP

POC on dataviz tools

- Participation in working groups on the choice of dataviz tool

Architecting ingestion and indexing processes

- Implementation of an architecture for launching ingestion and indexing processes by dynamically detecting new data

- Writing of the DAT (Technical Design Document)

Participation in the implementation of algorithms

- Guidance of design and development to comply with internal standards and best practices

- Support for designers and developers

Implementation of a spark/scala application for business valuation

- Design of the application architecture

- Creation of the database and associated tables on Hive

- Development of scheduling with Oozie

- Development of processes with scala/spark

Implementation of a CI/CD chain for Talend

- Define the CI/CD chain architecture

- Installation and testing of the different CI/CD modules (continuous integration and continuous delivery)

- Development of playbooks on Ansible Tower for the CD part

Evolutionary maintenance of a Scala/spark application for categorizing Banking operations

- Monitoring of existing process production

- Correction of anomalies in scala processes

- Development of evolutions in processes (Scala and Talend)

- Creation of external tables for data exploitation on the lake

- Optimization of categorization processes (scala/spark)

Implementation of a data warehouse and datamarts for reporting:

- Design of the application architecture

- Modeling and design of the business intelligence database model (data warehouse and datamarts)

- Development of feeding processes with Datastage PX

- Development of Control-M jobs for the execution and chaining of processes

Implementation of a reporting infocenter for banking mobility:

- Design of the application architecture

- Development of Talend processes that:

* Retrieve data from HDFS (Datalakes)

* Calculate various indicators and process raw data

* Inject data into the MongoDB database

- Development of the Web application on AngularJS

- Generation of reporting tables in Excel and allowing users to download them.

Migration of Vectorial database machines to Redhat 7.1

- Management of the migration of Linux Redhat 5.1 servers to Redhat 7.1 and the Vectorial database Harry Vectorial Server from version 32 bits to 64 bits.

- Definition of the capacity of the new machines.

- Define the target architecture and implement the migration plan.

- Adapt processes on the new machines.

- Development of business intelligence reports with the Harry Liberty suite

- Development of feeding processes for the Harry Vectorial Server Vectorial database

Tasks performed:

- Design and Development of new data feeding and extraction processes with Talend.

- Evolution of existing Talend processes.

- Design and development of processes for feeding an R-OLAP datamart with Talend.

- Implementation of the Talend Enterprise Data Integration version:

•Definition of the target Talend architecture.

•Installation of the different modules.

•Writing of installation documents for the Talend server and development studio.

•Finding solutions for using MétaServlet.

•Definition of the delivery procedure between different environments and development of delivery tools.

- Migration of Talend Processes from TOS version (Free) to TEDI version (Paid)

- Design and modeling of a Datamart (R-OLAP).

- Maintenance of the business intelligence tools for the prudential supervision information system for the financial markets directorate.

- Studies, design, and development of new evolutions (Talend / WebService / PL/SQL)

- Correction of anomalies in PL/SQL processes.

- Evolution of PL/SQL processes.

- Analysis and correction of production issues.

- Performance optimization of PL/SQL processes.