Youssef E.

- Analysis and design: Participation in business workshops, gathering functional requirements, writing and refining user stories. Design and development of Big Data applications, carrying out POCs and technical feasibility studies.

- Development and deployment: Implementation of PySpark processes, orchestration of processing chains with Airflow and Oozie, carrying out unit and integration tests, packaging applications in DAR format, and automated deployment via the CI/CD chain (Jenkins / XL Deploy) on dev, test, integration, and production environments.

- Management of evolutions: Cost estimation of evolutions, impact studies, and technological migrations.

- User support and assistance: Handling incidents, technical support, and accompanying business teams during acceptance phases.

- Agile Methodology: Participation in Scrum rituals (daily meetings, refinements, backlog reviews, demos, retrospectives, planning).

Big Data SI Evolution:

- Definition and implementation of Big Data technical solutions for various use cases.

- Design, development, deployment, and optimization of new evolutions and maintenance in operational condition (MCO).

- Implementation of pipelines for collecting, acquiring, integrating, and processing different types of data (real-time, deferred).

- Script Development:

- Python/Shell for data acquisition from APIs and web services.

- Spark/Scala for data integration and transformation into MongoDB.

- Jenkins for automation, orchestration, and scheduling of processes.

- Enrichment of development best practices in the Big Data field.

- Administration of the Big Data environment in Microsoft Azure Cloud (Datalake, Hortonworks Hadoop clusters, supervision of Spark services and VMs via Ambari).

- Creation and maintenance of technical documentation.

PaaS Migration and Projects:

- Migration of the Hadoop ecosystem, Jenkins (IaaS) to an Azure cloud environment (PaaS) with Databricks, Data Factory, DevOps, Data Lake Storage Gen2, Delta, etc.

- Collection schema: A process for integrating EDI (Electronic Data Interchange) invoices from various suppliers (EDF, ENGIE, TotalEnergies, etc.) and accounting invoices, for GLP.

- Invoice integration for each Client/Supplier pair: CDC, CD13, CD59, VFSB, etc.

- Integration of data from distributors (GRDF, ENEDIS, SUEZ):

- GAS (GRDF ADICT REST API)

- Electricity (Enedis SOAP API) / SGE Portal

- Water (Suez REST API)

- Objenious REST API (LoRaWAN): IoT platform for transmitting sensor data (Environment: Presence, Brightness, Temperature, Humidity). Study of migration to Orange.

Implementation of the BI and Big Data project for the RAF (Amicable and Forced Recovery) scope

- Carrying out POCs for the RAF scope.

- Development of Data Lake feeding flows from source data.

- Construction of Facts and aggregates from Data Lake data.

- Participation in functional and technical workshops with business stakeholders, CSRs, MOA, and MOEs for the preparation of DSF and DST.

- Creation of Datastage jobs to feed ODS, Socle, BMD (Base Métier Détail), and then BMA (Base Métier agrégée) tables.

- Carrying out patches, delivery for validation (v1 and v2), acceptance testing, writing the production deployment file, and validation of the deliverable with the operations team.

Management and Project Management for the RAF scope

- Cost estimation and planning of various evolutions and anomalies.

- Inputting progress tracking, sharing on advancement, setting milestones, and meeting deadlines.

- Assistance with requirements expression, writing DSTs, monitoring development, delivery for integration, integration testing, code review, validation of developments, verification of deliverable quality, adherence to standards, improvement of patch component quality, and handling and intervention on complex developments.

- Facilitating meetings: A daily progress meeting with developers and a weekly progress meeting with business stakeholders, CSRs, MOA, and MOEs on work advancement.