Aymen Berrima

Project 1: Migration of the Databricks workspace from the public Workspace to a private workspace within the TF1 network: Missions:

- Implementation of a zero-downtime switch strategy for the 300 Databricks jobs, orchestrated in Airflow.

- Development of migration functions for all workspace objects: Users / Notebooks / Instance_pool / secrets / ML Models / Libraries...

- Implementation of a Databricks object migration code that runs daily in Delta, to update only the changed objects: Python and Databricks API

- RBAC redesign for Databricks Users via Microsoft EntraID and SCIM

- Redesign of object types in Terraform: Clusters / Instance pools

- Standardization and migration of runtimes used in jobs to the latest LTS version.

- Migration of Azure VM families to a cheaper VM family (Dxa_v4 instead of Dxs_v3). Project 2: Responsible for TF1's DATA production system (Airflow): Missions:

- Management and upgrade of the Apache Airflow orchestrator to ensure the sustainability of TF1's Data production system

- Optimization and continuous support

- Standardization of our data flows orchestration under Airflow (API, FTP Export, Azure Data Factory, Azure Databricks)

- Skill development and then Lead of the internal DE team on the tool. Project 3: Optimization of Azure / Databricks production jobs Missions:

- Support for Data Analysis & Data Science teams in production architectures and Spark code optimization

- Implementation of Azure Data Factory flows.

- Review of notebooks with Data Analysis & Data Science teams before production deployment

- Production monitoring & maintenance of jobs towards new DBR runtimes

- Implementation of VM pools dedicated to production. Technical environment (TF1): Azure (Databricks, Data Factory, Event Hub, Event Grid, DevOps), Terraform, Docker, Airflow, Python, Pyspark, Snowflake

- Implementation of a data lake for the various brands of Compagnie des Alpes (leisure destinations and ski resorts) for e-marketing and data science purposes.

- Leading the project to migrate the Data Lake from Hortonworks to Databricks on full AWS cloud.

- Technologies: Databricks, Spark, Python, Talend, Cloud AWS (S3, Athena, EC2, RDS, ...), HDP, Google Analytics - Databricks Administration

- Migration from Talend 6 to Talend 8

PROJECT: GarantMe Reporting Portal Design and development of a BI application for monitoring GarantMe's activity (sale of housing guarantees to customers and property insurance) (Qlik Sense, PL/SQL).

• Requirements gathering and breakdown of needs into themes/subjects.

• Design and modeling of data to be presented.

• Development of Qlik scripts for populating the implemented data model.

• Development of the dashboard with Qlik Sense Desktop: - Reproduction of old PL/SQL reports with Qlik Sense. - Data extractions for the business team, covering the number of clients, issued guarantee certificates, number of cases created across several analysis axes. - Reporting statements for partner evaluation. - Dashboard for visualizing business performance indicators, this dashboard is interactive and allows the use of filters and real-time analysis.

• Technical and functional testing. Technologies: Qlik Sense, PL/SQL, MySQL Workbench, Jira.