Nassereddine Belghith

As an expert at CAGIP, I am responsible for designing and deploying robust and scalable infrastructures on Google Cloud Platform (GCP) and Amazon Web Services (AWS). I use Terraform to automate resource creation, employing a modular approach that ensures flexible management and simplified maintenance of cloud environments. To standardize projects, I integrate Cookiecutter, and I use GitLab CI to ensure efficient continuous integration. In the banking sector, where security is paramount, I ensure that deployments adhere to strict compliance standards, integrating Checkov policies for continuous security and compliance verification.

-Management of Databricks clusters: Creation and configuration via Terraform for scalability and cost optimization. Access security and implementation of auto-scaling policies.

• Monitoring the performance of jobs and applications, including Spark jobs, K8s applications, and Kafka, using tools such as Prometheus, Grafana, InfluxDb, Stackdriver, BigQuery, Rundeck, and Azkaban.

• Automation of alerts through various means such as email, PagerDuty, incidents, and chatbots. Monitoring of APIs and failed or long-running Spark jobs using Azkaban and Yarn APIs, with the ability to kill/execute jobs or workflows via Java 11.

• Use of Python 3.8, BigQuery Client API, GCS, K8s Kustomize, and GCR for monitoring BigQuery tables and views.

• Management of data ingestion via lambda functions such as Pub/Sub, Pub/Sub subscriptions, storage notifications, and GC logging alerts.

• Led the migration of Carrefour's photo solution to the cloud, including IIS, SQL Server, Elastic Search V7, DollarU, GCE, REST APIs, and web services.

• Migration of the GDS solution to Google Cloud Platform (Google Cloud Storage for file versioning, data transfer from Azure to GCS, IaC: Terraform, Ansible, and Rundeck).

• Migration of ElasticSearch from version v7.9.2 to v8.12.0, via v7.17.6, involving the migration of over 60 clients (APIs and indexing batch jobs) as well as the migration of Kafka Elasticsearch Connect to version v14.0.2, with minimal service interruption and good RTO.

• Management of Cloud Functions migration from the first to the second generation. -Supervised the migration of Spark jobs from Dataproc to Dataproc Serverless, integrating advanced infrastructure to improve resource management, optimize costs, and automate deployments (Backend, Network, DevOps, Monitoring, and Alerting).