Mohamed Chedly Essid

- Built and deployed ETL/ELT workflows to meet diverse global business requirements across ingestion, transformation, and delivery layers.

- Designed and led core platforms including Airflow "Orchestrator as a Service" and Starburst "Query as a Service", standardizing automation and improving performance across data workflows.

- Contributed in the development of a pipeline generator tool that automatically create Starburst DDL/DML scripts and Airflow DAGs, cutting manual effort by 80%.

- Implemented CI/CD pipelines with GitLab and Docker, streamlining deployments across staging and production.

- Contributed in full data lifecycle architectures using Airflow, Spark, and Starburst for optimized data processing.

As Chief Data Architect, I drove data transformation initiatives globally, aligning technical strategy with business goals to optimize performance, resilience, and scalability. Key Highlights:

• - Spearheaded due diligence to diagnose and resolve bottlenecks in the Ferrovial platform on Microsoft Azure.

• - Enhanced performance by optimizing Databricks, Power BI, and Azure components, eliminating bottlenecks, and implementing robust data management, dashboards, and ETL workflows.

• - Implemented CI/CD pipelines to streamline deployment processes, ensuring consistent, reliable updates across the platform.

• - Orchestrated disaster recovery efforts in partnership with Microsoft support, restoring critical infrastructure swiftly while implementing a resilient data recovery framework to protect sensitive information and minimize operational downtime.

• - Designed a multilingual MLOps generative AI model for the Generalitat of Catalonia.

Supported Microsoft's HDInsight and Databricks teams in the EU and MENA regions, providing technical expertise for Hadoop ecosystem components, Databricks, and Azure Synapse. Ensured optimal system performance, addressing setup, code review, and bug fixes within SLAs. Key Highlights:

• - Addressed client issues across ETL pipelines, CI/CD, performance optimization, patches, and bug resolution.

• - Supported client migrations to HDInsight and Databricks, ensuring seamless transitions with minimal disruption.

• - Collaborated with cross-functional teams to resolve incidents, document solutions, and update the knowledge base, enhancing resource accessibility.

• - Delivered client training sessions to empower users and optimize platform utilization.

• - Assisted with data migration, disaster recovery planning, and developed CI/ CD pipelines and robust data workflows to improve operational efficiency.