Denis Thong Van

Creation of automated workflows (Jobs) to perform data transformations using Matillion

Orchestration of data transformation jobs

Ingestion of data from SAP / Files into datalake tables from Matillion

Creation and population of data warehouse tables in Snowflake

Development, testing, and deployment of Matillion Jobs

Use of Python in Matillion for faster file movement/archiving after processing

Writing / Maintaining delivery tracking in testing and production

Implementation of a complete analytical solution, in lakehouse mode (medallion architecture) built within the Microsoft Fabric ecosystem

Creation of a generic data feeding framework for the silver layer (data quality) using Spark

Data ingestion into the bronze layer (raw data) by setting up a module entirely in Python to copy files from the client's SFTP

Populating the Gold and Platinum layers of the lakehouse with Spark notebooks, with one spark notebook per table to take into account client specificities

Using Fabric Pipelines to orchestrate and schedule all processing

Data modeling with Power BI

Setting up a weekly maintenance process

Writing specifications