Freelancer profile translated to English.

Description

Expert in the development and optimization of data pipelines. In-depth mastery of data management processes, from collection to exploitation, including governance, security, and quality control. Specializes in implementing high-performance solutions compliant with industry standards, ensuring the integrity and optimal valorization of the company's data assets.

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Paris (up to 50km)

EDF
Data Engineer
ENERGY AND UTILITIES
September 2021 - Today (4 years and 9 months)
Nanterre, France
-Maintenance of production operations.
Design and implementation of efficient processes for incident management.
-Management and optimization of the Data Warehouse to ensure maximum integrity and performance.
-Development, optimization, and industrialization of data pipelines to improve their efficiency and reliability.
-Implementation and configuration of the Apache Airflow platform to optimize workflow management, accompanied by a redesign of jobs into DAG format and customization of associated operators.
-Orchestration of the transition of our service portfolio to a modern containerized architecture, thereby optimizing operational flexibility and efficiency.
-Implementation of a comprehensive automation strategy and orchestrated deployment of services in a Kubernetes cluster architecture, thereby optimizing infrastructure scalability and resilience.
-Implementation and configuration of CI/CD pipelines.
-Implementation of the DBT tool to optimize and streamline SQL code generation, thereby improving the management and efficiency of database objects.
-Implementation of the OpenMetadata platform to meet data governance requirements, encompassing data catalog management, lineage establishment, creation of a comprehensive data dictionary, and ensuring data quality.
-Development of an API for secure and optimized exposure of data from the data warehouse.
- I served as Scrum Master within the team, guiding and facilitating the application of agile principles to optimize group productivity and efficiency.

Functional scope: valorization of IT data from EDF's DSIT

Technical scope: Python, Bash, SQL, PostgreSQL, Linux, DBT, Docker, Kubernetes, AWS S3, HDFS, GitLab (CI/CD), Airflow, Grafana, Prometheus
DATANEO
Data Engineer
July 2020 - May 2021 (10 months)
Île-de-France, France
Reporting to the Data department under the responsibility of the CDO and the Data Manager, involved in the maintenance of applications related to data quality and the company's production data:
- Identification of source data, management of data integration, and optimization of production processes.
- Development, scheduling, and configuration of production processes.
- Participation in the administration of applications and databases.
- Writing operational documentation, operating procedures, and instructions.
- Participation in the analysis and design of company projects (integration of new client accounts, application development, etc.). Tools: Python, Bash, SQL, MySQL, Oracle, ElasticSearch, Php, Amabis, Airflow
Lextenso
Data Engineer
January 2020 - May 2020 (4 months)
Île-de-France, France
Redesign of the data management system to improve the processing and preparation of legal data for the publisher's clients.
- Analysis of the architecture of the old data preparation system.
- Migration to a new Talend version and its dependent libraries.
- Pipeline development.
- Maintain the old system and resolve bugs. Tools: Talend, Java, Shell