Freelancer profile translated to English.
Back to original languageAbout Arthur
Driven by a real passion for big data and artificial intelligence, I have 10 years of IT experience, including 7 years in data architecture and engineering. My expertise is demonstrated in the design, implementation, and optimization of data platforms, both on-premise and in cloud environments. Throughout my career, I have developed a strong command of data frameworks and pipeline construction, effectively meeting business needs.
French
Native or bilingual
English
Fluent
Can work on-site
Paris (up to 50km)
Experience
- ICDC (Informatique Caisse des Dépôts et de Consignation)Senior Big Data EngineerJuly 2024 - Today (1 year and 11 months)Paris, FranceTasks: Development of Spark processing for feeding a Business Vault layer, particularly for calculating indicators such as financial exposure on credit and investment tranches. Optimization of Spark processing to significantly improve pipeline performance and robustness. Technical environment: Spark, Python, SQL, Hadoop (Cloudera)
- AllianzSenior Big Data EngineerJune 2023 - Today (3 years)CGI, on assignment at Allianz France Since June 2023 (1 year) Design and development of a data transformation chain on Azure, according to the Data Vault 2.0 model. Tasks:• Parsing CSV data and writing Delta files to storage accounts.• Creation of Raw Vault and Business Vault entities in Delta Lake using DBT (Data Built Tool) and Trino.• Deployment of containers on AKS (Azure Kubernetes Services).• Design and implementation of a Kubernetes component for automatic export to external SFTP servers.• Implementation of data tests with DBT. Technical environment: ADLS Gen2, AKS (Azure Kubernetes Services), DBT (Data Build Tool), Pyarrow, delta-rs, Trino, ArgoCD, Github actions
- AMADEUSBig Data EngineerJune 2022 - June 2023 (1 year)KLANIK KORNER on assignment at AMADEUS Villeneuve-Loubet From June 2022 to June 2023 (1 year) Creation and qualification of a Datamart calculation pipeline with Databricks and Snowflake. Tasks:• Collection of Avro files on Azure, calculation of Datamarts with Databricks and feeding Snowflake.• Enrichment of Datamarts using reference data located on Azure and Snowflake optimization.• Optimization of Spark jobs for improved processing times (tuning configuration parameters, cluster sizing, code improvement).• Implementation of Scala and SQL scripts for automatic data quality validation. Technical environment: Snowflake, Spark, Scala, SQL, Databricks, Azure, Bitbucket, Jenkins, Jira
Recommendations
Be the first to recommend Arthur
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Computer Engineering Design DiplomaNational Higher Polytechnic School2015Diplôme d'ingénieur de conception en informatique
- Baccalaureate CBilingual High School2010Baccalauréat C