Matthias G

Development of batch data pipelines around credit risk. AWS cloud stack (Lambda, Glue, S3). Orchestration on Airflow.

Responsible for the entire project cycle, from pre-sales to production, as part of the migration of an existing system from Teradata to Azure Databricks. Technical management of the sales accounting system migration. Design and development of processing pipelines for loyalty cards, customer subscriptions, and strategic business indicators (station traffic, CO2 consumption, kilometers/passenger, etc.). Implementation of high-performance distributed processing under Spark (Scala). Automation of deployments and CI/CD processes with Jenkins and Ansible. Scrum Master responsibilities: animation of agile ceremonies (Daily, Sprint Planning, Reviews, Retrospectives), management of obstacles and blocking points, facilitation of exchanges between technical and business teams.

Design, development, documentation, testing, and deployment of various flows to feed a data lake in the banking sector. Migration of data and applications from a Hortonworks platform to Cloudera. Development of Kafka streaming flows and Spark batch flows. Creation of Oozie workflows to schedule Big Data processing. Monitoring and tracking of production processes. Work carried out in agile SCRUM mode.