Freelancer profile translated to English.

Description

I am a freelance data engineering specialist, passionate about creating robust solutions for managing, processing, and analyzing massive data volumes. With solid data expertise, I offer my services to help companies leverage the value of their data.

I design, develop, test, and maintain efficient, redundant, and scalable data pipelines using cutting-edge technologies such as Databricks and DBT, as well as cloud computing services like AWS and GCP.

I am also skilled in setting up databases, performance optimization, implementing distributed architectures, and integration and delivery chains.

I am primarily looking for remote or hybrid work opportunities.

Industry field of expertise

Languages

French
Native or bilingual
English
Fluent
Japanese
Basic
Chinese
Basic
Spanish
Basic

Workplace preferences

Can work on-site

Lille (up to 40km), Paris (up to 10km)

ADEO Services
Data Engineer
RETAIL (LARGE RETAILERS)
November 2022 - Today (3 years and 9 months)
Lille, France
Context:

In the Supply Receiving Check team integrated into ADEO's Supply Data Chain Platform (SCDP), I participated in the industrialization and international scaling of our AI product "Receiving Check," which predicts defective packages upon arrival to facilitate in-store and warehouse checks via an API.

I collaborated with a Data Analyst and a Data Scientist for dataviz and AI needs, and a Software Engineer for API requirements. The team consisted of 7 to 10 people working in Agile Scrum mode.

Technical Achievements:

Data Engineering:
Data collection, design, development, and testing of data flows on BigQuery/Postgres/DBT.
Industrialization of the project for the integration of new countries (Portugal, Brazil, Italy, France) and implementation of corresponding data flows.
Implementation of a testing strategy for our pipelines.
POC of the great expectations testing library.
Improvement of existing flows by implementing good code practices.
Development of data pipelines based on the GCP environment for the Data Lake (GCS) and Data Warehouse (BQ)/Postgres.
Orchestration of our flows with Airflow on the Composer service (GCP).
CI/CD and versioning via Github / GH Actions.
Technical documentation on Confluence and Collibra.
Data provisioning on Firestore then Postgresql/BQ via data marts.
End-to-end redesign of the project architecture on DBT to facilitate the development and deployment of new data features.
Exploratory analyses using the Pandas library and Jupyter notebooks.
Maintenance and run of ETL jobs on Dataflow, Cloud Functions.
Identification of data sources and ensuring data access for the entire team (GCP IAM rights management).
Implementation of Kafka (Avro) flows and connection to BigQuery.

System Engineering:
Design, development, and testing (unit/integration/e2e) of new API functionalities using Python and Fast API.
Deployment of the API on Turbine (internal tool for container orchestration) and integration of various new countries.
Testing and implementation of new test scenarios on Postman.
Technical run, monitoring, continuous improvement, and production deployment.
Management of the API interface contract (Pydantic).
Monitoring and tracking of API performance using metrics (SLO/SLI/SLA) on Datadog.
Versioning and CI/CD Git/Github.
Implementation of Datadog and Kafka logging for integration into BigQuery for analysis/reporting purposes.
GCP Google Cloud Platform BigQuery Airflow Composer Google Cloud Functions Logging Datadog Git/Github Github Actions Github Copilot Fast API Apache Kafka PostgreSQL Google Cloud Storage DBT Test Automation CI/CD Collibra Pandas Jupyter Dataflow Apache Avro System Engineering Data Engineering API Python Programming Python Identity and Access Management (IAM) Software Craftsmanship Firestore Great Expectations Monitoring
Decathlon
Big Data / Spark Consultant
RETAIL (LARGE RETAILERS)
January 2021 - November 2022 (1 year and 10 months)
Lille, France
Gathering client requirements, designing, developing, and performing unit and integration tests for ETL Spark or Spark Streaming Pipelines using the Spark Scala 3.1.2 framework.
Utilizing AWS Cloud for Data Lake (S3) and Data Warehousing (Redshift), Glue for metastore, and Athena for exploratory analysis.
Using Spark on the Databricks platform for data exploration, analysis, and development of dashboards for data quality monitoring and traceability.
Implementing control towers for data quality verification and traceability.
Making data available to users on Redshift/S3.
CI/CD and orchestration of jobs with Jenkins on the various implemented ETL projects.
Git/Github versioning.
Airflow training.
Technical run, monitoring, and continuous improvement of flows.

Functional Achievements:
Project monitoring using the Atlassian suite.
Requirements specification matrix for new user stories.
Workshops to establish best practices on the team's various projects (Code Review / Tests / Dev Standards).
User support for the implementation of new user stories (tres amigos, regular contact, demos, etc.).
Incident management (Run) and user support/communication.
Technical/functional documentation of flows (new and existing) on Confluence and Collibra. Onboarding and support for new data engineers joining Decathlon.
Amazon Web Services Amazon Redshift AWS S3 Git GitHub Gitflow Scala Github Actions Spark Streaming Spark Databricks Jenkins Unit Tests Data Analysis Agile Methodology Scrum AWS Glue AWS Athena Airflow Atlassian JIRA Atlassian Confluence
ADN AxDaNe
Data Engineer & RPA Engineer
PHARMACEUTICALS INDUSTRY
September 2019 - September 2020 (1 year)
Levallois-Perret, France
Main missions: Implementation of artificial intelligence algorithms for health system validation and requirements identification:
Languages: Python, SQL
Frameworks: Pandas, Spark, SparkNLP, Scikit learn, NLTK...
Algorithms: SVM, Natural Language Processing (NLP), Naives Bayes, Logistic Regression, Word2Vec, BOW, TF-IDF...
Implementation of the Robotic Process Automation (RPA/RCA) platform Automation Anywhere:
Installation and administration in the AWS cloud.
Administration of the AAE 2019 platform.
Development of software robots (RPA) and cognitive robots IQ Bot (RCA).
Study for the validation of cognitive robots.
Presentation of a Webinar on AAE 2019 and its applications in healthcare
Secondary:
Training on AWS cloud (DynamoDB, Lambda, SageMaker).
Training and familiarization with the 3DEXPERIENCE platform from Dassault Systèmes.
Training and RPA Certifications on Automation Anywhere
AWS DynamoDB SageMaker Apache Spark MLlib Spark Python AWS EC2 AWS S3 Automation Anywhere Pandas Scikit-learn Natural Language Processing (NLP) Sonar Bitbucket Atlassian JIRA Atlassian Confluence

Check out Yaouen's experience

Be the first to recommend Yaouen

Help this freelancer shine by sharing your experience working together.

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

Baptiste Duhen

Fullstack developer

4.6

(4)

Amed Hamou

Senior Lead Developer

(2)

Audrey Champion

Web developer

4.3

(3)

Signup to reveal

Generalist Engineering Degree, Major in Big Data
Ecole Supérieure d'Électronique de l'Ouest - ESEO Angers
2020
Diplôme d'ingénieur Généraliste, spécialité Big Data
MOOC Project Management Certification, Classic Track
MOOC Project Management
2018
Certification MOOC Gestion de Projet, Parcours classique

Check out Yaouen's education

DevOps

Yaouen Vandenbossche

Data Engineer | Cloud | Airflow | DBT | Spark

About Yaouen

Experience

Recommendations

These freelancer profiles also match your criteria

Education

Skill set

Categories