Freelancer profile translated to English.

Description

Experienced data engineer, I offer my services as a Big Data team Tech Lead.

Proficient in big data environments and expert in developing data processing jobs in Scala/Spark, I am able to share my knowledge with any data engineering team, whether at the software development or organizational level.

This includes in particular:

- setting up a datalab for your data analysis needs

- ensuring code quality to improve development time for each feature

- training junior data engineers to quickly become productive team members

- analyzing the performance of a big data pipeline to speed it up or make it more reliable

- assisting in defining needs by interacting with business users

- proposing organizational improvements to streamline the development of your application

- industrializing models developed by your data scientists

Languages

Spanish
Basic
Chinese
Basic
English
Fluent
French
Native or bilingual

Workplace preferences

Can work on-site

Paris (up to 50km), Courbevoie (up to km), Puteaux (up to km), Paris (up to km)

Believe Engineering
Data Engineer Senior
FILM AND AV
June 2020 - Today (6 years)
Paris, France
Creation of sales reports from raw data provided to Believe Digital by streaming platforms (Spotify, Youtube, etc...)

Development of data processing Spark jobs in Scala
Development of a raw data download module in Python
Orchestration of jobs on a Databricks cluster hosted on Amazon Web Services
Storage of sales reports with Deltalake
scala spark databricks deltalake Amazon Web Services Python Gitlab Git Atlassian JIRA
Societe Generale SA
Lead Data Engineer
BANKING AND INSURANCE
October 2018 - November 2019 (1 year and 1 month)
Courbevoie, France
Supervision of a team responsible for providing data for the bank's compliance department

Development of data processing Spark jobs in Scala
Organization of daily job execution on a Hortonworks cluster with Oozie
Automated deployment of jobs using Ansible
Development of Ansible modules in Python
Creation of Python job launch scripts
Supervision of a team composed of two junior data engineers
Guarantee of adherence to agile methods within the team
Technical referent for the definition of new business flows
Scala Spark Hadoop Ansible Oozie Hortonworks Python Maven
SOLOCAL
Lead Data Engineer
PRESS AND MEDIA
July 2016 - May 2018 (1 year and 10 months)
Boulogne-Billancourt, France
Supervision of a team transforming raw audience data from Yellow Pages (among the top 15 French sites) into a model for analysis by sales and marketing teams

Development of data processing Spark jobs in Scala
Organization of daily job execution on a Cloudera cluster with Azkaban
Automated deployment of jobs using Ansible
Supervision of the team's skill development in Spark/Scala
Introduction of agile methods into team organization (Kanban)
Technical referent in a team of 4 developers
Spark Scala Ansible Hadoop cloudera Azkaban yarn git gitlab taiga jenkins nexus

Check out Vincent's experience

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

Baptiste Duhen

Fullstack developer

4.6

(4)

Amed Hamou

Senior Lead Developer

(2)

Audrey Champion

Web developer

4.3

(3)

Signup to reveal

General Engineer
École Centrale de Nantes
2012
Master of Computer Science
Tsinghua University (Beijing, China)
2012
Spécialisé en intelligence artificielle

Functional Programming Principles in Scala by École Polytechnique Fédérale de Lausanne
Coursera
2013
https://www.coursera.org/learn/progfun1
Scala
Machine Learning by Stanford University
Coursera
2014
https://www.coursera.org/learn/machine-learning
Machine learning

Data Engineer

Software Engineer

Vincent Doba

Tech Lead Data Engineer - Spark / Scala

About Vincent

Experience

Recommendations

These freelancer profiles also match your criteria

Education

Certifications

Skill set

Categories