Freelancer profile translated to English.

Description

I have been passionate about data since 2010, I like to take on new challenges, share my know-how and learn from others. I regularly keep up with technological advancements to update and improve my skills.

Languages

French
Native or bilingual

Workplace preferences

Remote only

Primarily works remotely

SNCF
Big Data Consultant
TRANSPORTATION
March 2018 - Today (8 years and 5 months)
Stade de France, Saint-Denis, France
BDT Program: Migration of BDV, BDT, BDI, and BDR applications
Role: Lead Dev
Objectives:
 Participation in Passive / Active reversibility workshops.
 Migration of applications developed in Hql on HDI to AKS in Spark Scala.
 Development of AirFlow DAGs for processing orchestration.
 Development of ADF pipelines for the DataViz team.
 Writing technical and functional documentation.
 Correction of anomalies on Hql applications in GEN1.
 Organization of skill-building and continuous improvement workshops.

Other missions within the SNCF group
Project-1: BREHAT INCIDENT / BREHAT Mobility
 Development of a Spark job to parse XML data into CSV format and ingest it into a relational database
 Development of unit tests
 Development of SQL stored procedures for table updates
 Writing technical and functional documentation
Project-2: PSS (Surveillance and Monitoring Program)
 Development of a Spark job to flatten metadata in XML format and ingest it into a relational database
 Development of unit tests
 Development of SQL stored procedures for table updates
 Development of a QlikSense Dashboard for visualization
 Writing technical and functional documentation
Project-3: Zettanium
 Development of a Spark job for calculating indicators on entries/validations and fraud in stations
 Development of unit tests
 Creation of Ansible job for production environment automation
 Writing technical and functional documentation
Project-4: SQCD (SNCF Matériel division) / MRT (SNCF Mobilité division)
 Development of ADF pipelines for data copying from BlobStorage / DataLakeStore / Data Warehouse to SQL database
 Development of T-SQL stored procedures
 Writing user documentation
 Training business users on ADF tool usage
 Deployment in production environment
Project-5: DSMAT (Predictive Maintenance of Trains)
 Development of Spark jobs for calculating indicators (train lifespan)
 Development of a Python job for calculating Weibull parameters (survival analysis)
 Development of unit and integration tests
 Optimization of Spark processing
 Writing application documentation
 Deployment in production environment
 Agile Scrum Methodology
Project-6: NAOMI
 Development of Spark jobs to parse JSON files into Parquet and calculate indicators on passenger trips, tickets, abandonment cards, options
 Development of unit tests
 Optimization of Spark processing to reduce processing time
 Data availability for the Talend team
 Writing application documentation
IT NOVEM - Data Engineer Spark Scala/Python – 03/2018 – 08/2021
Alpha DIALLO [email protected] +33(0) 7 81 42 81 27
Project-7: QsExpert
 Data acceptance testing for the QsExpert application in CSV / JSON / ORC format
 Proposal of an acceptance test plan for business users
 Development of a Databricks Notebook template for automated testing
 Creation / validation of acceptance test campaigns and iterations in Squash
CGI
Big Data Consultant
April 2016 - Today (10 years and 4 months)
La Défense, France
With a strong passion for Data, I currently work with several Big Data technologies and tools: Spark, Hive, Impala, Hue, sqoop, flume, Nifi, kafka, UNIX Shell, scala, Python, Java...
Orange
BIG DATA / BI Consultant
TELECOMMUNICATIONS
November 2015 - August 2016 (10 months)
Orange Erable is a Big Data project that aims to collect and transform real-time data using Big Data technologies.
 Writing of technical and functional specifications.
 Writing of a test validation document for VABF (Verification of Fitness for Purpose).
 Contribution to the setup of the POC architecture.
 Familiarization with the Hadoop ecosystem with the Hortonworks distribution.
 Proposal of a Git workflow to the development team.
 Development of Kafka connectors (consumer & producer).
 Development of a Spark job to transform raw data into refined data.
 Implementation of connectors in the Kafka Connect server.
 Implementation of unit tests.
 Compilation and correction of project source code quality with Jenkins and Sonar tools.
 Implementation of integration tests.