Freelancer profile translated to English.

Description

Graduate engineer fromENSIMAG**, I mainly work on **AWS Data Platformsand have had the opportunity to support several companies includingstartups, scaleups, and large groups**, in **various business sectors(Banking, transport, health) and **different business contexts**.

AWS Developer Associateand **Data Engineer Associate certified**, I can help you set up efficient data processing pipelines within the AWS ecosystem and guide you towards the most suitable services and technologies for your use case and context.

My preferred topics:

ETL
Datalake / Data Lakehouse
APIs
Clean Code
Infrastructure as Code
CI/CD

Industry field of expertise

Languages

French
Native or bilingual
English
Native or bilingual

Workplace preferences

Can work on-site

Grenoble (up to 50km), Lyon (up to 50km)

Bpifrance
Data Engineer / Tech Lead
BANKING AND INSURANCE
April 2023 - Today (3 years and 3 months)
Paris, France
Modernize Python projects by adding a Dependency Manager (Poetry), Linters, Formatters, etc., to unify developer tools and facilitate their work
Make CI/CD Pipelines on Jenkins more robust by adding code quality checks and unit tests before any deployment
Maintenance of Spark code for table ingestion and transformation.
Refactoring code to make it more testable and reusable
Modernize the data storage part of the platform by switching from CSV to Parquet and Iceberg
Develop a DataGalaxy connector that allows dynamic addition of table Lineage using OpenLineage.
Development of connectors for the Anaplan management tool that allow automatic extraction/integration of files from/to AWS using the Anaplan API.
Spark Amazon Web Services Apache Iceberg Terraform Anaplan
Free2Move
DataOps/Data Engineer
TRANSPORTATION
May 2022 - April 2023 (1 year)
Build AWS infrastructure for a streaming pipeline with a large volume of data (EMR, Kinesis, S3, Lambda)
Creation and maintenance of the project's CI/CD pipelines (Terraform, Spark on Scala, Lambdas on Python)
Maintenance of the main Spark Streaming application code
Development of a Lambda to monitor business aspects with alerting on Google Chat
Implementation of Dashboards to monitor infrastructure load (EMR, Kinesis, S3,...) on Grafana
AWS EMR AWS Kinesis Terraform Scala Spark
SANOFI
Data Engineer
PHARMACEUTICALS INDUSTRY
April 2021 - May 2022 (1 year and 1 month)
Grenoble, France
Maintain and improve Spark (Scala) ingestion jobs in the platform
Maintain pipeline orchestration with Stepfunctions and Lambdas (Python)
Improve the readability of the platform's Catalog by implementing a tool that facilitates adding metadata to the platform's Glue catalog from a configuration file
Enrichment of unit tests and end-to-end tests for the platform and the entire codebase
Maintain and improve the platform's CI/CD pipelines
Maintain AWS infrastructure as code (Cloudformation)
Python Apache Spark AWS CloudFormation Scala Amazon Web Services