Freelancer profile translated to English.
Back to original languageAbout Johann
Looking for a Data Engineer?
Do you want to design or optimize your data pipelines?
I am a senior Data Engineer with over 8 years of experience in various sectors such as pharmaceuticals, retail, and finance.
I have collaborated with companies such as Sanofi, Carrefour, Société Générale, and Natixis.
I am certified on Databricks and AWS.
I can assist you with:
✅ Design, modeling, and migration of your data/cloud platform
✅ Development and industrialization of data processing pipelines
✅ Automation of Data Ops: Git, Jenkins, CI/CD
✅ Data collection and exploration
✅ Development of Spark Scala applications for large-scale distributed data processing
✅ Contribution to CI/CD improvement
✅ Maintenance of your data stack and applications
✅ Data modeling
I also have knowledge of:
• Databricks, Spark, PySpark, Delta Lake, LakeHouse, Kafka, SQL, Hadoop, HDFS, Hive
• Scala, Python, Java
• AWS
• Terraform, Ansible, XLDeploy / XLRelease
• Power BI
• Scrum, JIRA, Confluence
• Functional programming, Unit Tests, BDD
I am also committed to delivering my projects on time. In fact, I can provide you with a number of recommendations that can attest to this.
Do you have a project?
Contact me on Malt, I respond very quickly.
---
data engineer aws, data engineer big data, data engineer python, data engineer spark, data engineering, data engineer snowflake, data engineer databricks, data engineer dbt, data engineer scala, data engineer sql, data engineer airflow
French
Native or bilingual
English
Fluent
Can work on-site
Paris (up to 50km), Lyon (up to 50km), Marseille (up to 50km), Bordeaux (up to 50km), Toulouse (up to 50km)
Experience
- NatixisData EngineerBANKING AND INSURANCEMay 2023 - Today (3 years and 3 months)Paris, France
Project: P&L Calculation – Risks Team
Natixis is a subsidiary of the BPCE group. In 2023, it employed 16,000 employees with a net banking income of €9.2 billion.I joined the Market Risk team to participate in P&L calculation.The team consisted of:• 5 Data Engineers• 2 Business Analysts• 1 Project ManagerAs a Data Engineer, I was responsible for:• Developing new calculation processes and integrating new data sources• Adhering to global SLAs defined by geographic region• Optimizing Spark jobs• Migrating to Spark 3 to improve performance and reduce processing times• Implementing and maintaining Power BI dashboards to monitor production• Automation and deployment via CI/CD• Support and management of the application in production, including on-call duties.I contributed to the following developments:• 30% reduction in processing time• Improved scheduling, allowing data to be available faster for decision-makers• Enhanced reliability and simplified production monitoring• Real-time refresh rate for reports• 50% increase in code coverageTechnical context: Spark, Scala, Python, PySpark, Databricks, Kafka, Cloudera, ElasticSearch, ELK, Control M, GitHub, Jenkins, SonarQube, Power BI, IntelliJ, Scrum Methodology, Unit tests, BDD - NatixisData EngineerBANKING AND INSURANCEMarch 2022 - May 2023 (1 year and 2 months)Paris, France
Project: Market Reserves Calculation – Risks Team
Natixis is a subsidiary of the BPCE group. In 2023, it employed 16,000 employees with a net banking income of €9.2 billion.I joined the Market Risk team to participate in the calculation of market reserves.The team consisted of:• 8 Data Engineers• 3 Prototypers• 1 Project ManagerAs a Data Engineer, I was responsible for:• Decommissioning old reserve calculation processes, which were obsolete in terms of methodology and were running on tools to be retired from the group.• Developing and industrializing new reserve calculations in collaboration with prototypers• Implementing unit tests and integration tests to ensure the robustness of developments• Optimizing Spark jobs• Managing deployments and automation via the CI/CD pipeline• Support and maintenance of the application in productionI contributed to the following developments:• Improved calculation accuracy• Reduced reporting errors• Enhanced reliability and simplified production monitoringTechnical context: Spark, Scala, Cloudera, Control M, GitHub, Jenkins, IntelliJ, Scrum Methodology, Unit tests, BDD - Société GénéraleTech Lead Data EngineerBANKING AND INSURANCEMarch 2018 - March 2022 (4 years)Fontenay-sous-Bois, France
Project: Data Control Results Visualization Solution – Data Quality Team
Société Générale is one of the main French banks and one of the oldest, founded in 1864. It currently employs over 119,000 employees serving approximately 26 million customers in more than 62 countries worldwide.I joined the Data Quality team to participate in the creation of a data control engine common to the entire group.The team consisted of:• 5 Data Engineers• 2 Business Analysts• 1 Scrum Master• 1 Project ManagerAs a Tech Lead Data Engineer, I was responsible for:• Training and supporting client teams in performing their data controls• Optimizing extracted code to adhere to Spark best practices• Developing the test suite• Redesigning the application to simplify the framework's adoption by clients• Implementing the CI/CD pipeline to automate deployments• Leading technical workshopsI contributed to the following developments:• 75% average gain in processing performance• Increased ease of framework adoption• Enhanced project stability through tests and CI/CD• Adoption of the framework by several new clients• Hundreds of new data controls performed, improving overall data quality within the groupTechnical context: Spark, Scala, Azure, Cloudera, Hortonworks, Ansible, GitHub, Jenkins, RedHat, IntelliJ, Scrum Methodology, Unit tests, BDD
Recommendations
+1
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Master of ScienceSUPINFO - The International Institute of Information Technology2016
- BTS SIOLycée Parc de Vilgénis2013
Certifications
- Databricks Certified Data Engineer AssociateDatabricks
- AWS Certified Cloud PractitionerAmazon Web Services Training and Certification2020