Freelancer profile translated to English.

Description

DataOps Engineer & Kafka Expert - Real-Time Data Solutions Architect

With 8+ years of experience, I design and deploy scalable, secure, and optimized data architectures for real-time streaming and analysis.

Specializing in the Confluent Kafka and GitOps/DataOps ecosystem, I help companies to:

Build turnkey "Kafka as a Service" platforms.

Self-service Kafka cluster administration APIs for your teams

Performance and cost optimization

Implement robust CI/CD pipelines (Kubernetes, ArgoCD, GitLabCI, Jenkins).

Automate and monitor their infrastructures (Ansible, Prometheus, Grafana).

End-to-end support: from PoC to production, including team training.

Want a reliable and high-performance data infrastructure? Let's talk!

Industry field of expertise

Languages

French
Native or bilingual
English
Fluent
Arabic
Native or bilingual

Workplace preferences

Can work on-site

Paris (up to 50km)

Crédit agricole
DevOps/DataOps & Kafka Expert
March 2021 - February 2025 (3 years and 11 months)
(Crédit Agricole Group Infrastructure Platform)
Mission: Co-construction of Streaming Kafka as a Service and Topic as a Service offerings
• Construction of +40 Apache Kafka clusters with the Confluent ecosystem:
• VM Provisioning,
• Confluent Kafka ecosystem installation,
• Monitoring tools installation: Prometheus, Grafana, and Alertmanager
• Development/deployment of a REST API for Kafka resource administration
• Deployment of Kafka Cruise Control across all clusters.
• Deployment of the Conduktor solution.
• Kafka Run/On-call management for +40 clusters
• Confluent support via PS, workshops, and weekly meetings
• Conduktor support via workshops
• Migration of Kafka clusters from a CentOS platform to an Ubuntu platform
• Kafka cluster version upgrades
• Migration of Kafka clusters from a two-data center platform to a new three-data center platform
Confluent Kafka Stack, KConnect, KStream, KSQL, Schema Registry, Conduktor & Cruise Control DevOps/GitOps: Ansible, K8S, Docker, GitLab, Jenkins, ArgoCD, Helm, Kluctl, Kustomize, JFrog / Artifactory; Infra: Openstack; Languages: Python 3.10, Groovy, Shell Monitoring: Prometheus, Grafana, Alertmanager, Sensu Project Management / Run: Jira, Scrum, Service Now
SAINT GOBAIN
Big Data & DevOps Engineer
August 2018 - February 2021 (2 years and 6 months)
Mission: Architecture, Industrialization, and RUN of Data Science projects (Pricing, Churn rate, segmentation, Marketing opportunities)
• Automation of data validation (quality, availability, and freshness of data)
• Optimization and/or rewriting of code delivered by data scientists (Memory profiling, logging, scalability, settings, etc.)
• Implementation and automation of ML model CT (Continuous Training) pipelines
• Deployment and performance monitoring of ML models
• Design and development of Rest APIs for exposing ML models and/or optimized data
• Application security (TLS and Kerberos, SSO, JWT)
• Implementation of CI/CD pipelines for APIs
• Testing, integration, acceptance, and production deployment
• Monitoring of applications in production
• Migration of all projects from AWS to Microsoft Azure
• Definition/Writing of operating procedures and architecture documents
Stack Big data Cluster (Hadoop Cloudera Distribution); CDH, CDSW, Cloudera Manager; Apache Spark, Apache Sentry, Hue, Hive / Impala, HDFS, Hbase, Python, Django Rest Framework, Pandas Plotly Dash, Streamlit, Scikit-Learn, Jira, Confluence, Git / GitLab, Docker / Docker Swarm / Docker Compose, Jenkins, Nexsus, Portainer, XLDeploy, Swagger, Kerberos, ELK, Filebeat, Dynatrace, API
Action Logement
Data Engineer & Dev
April 2018 - July 2018 (3 months)
Within the KYC process for the Visale Project:
• Collection of data (identity, supporting documents, additional information) regarding the applicant and co-applicant for a Visale guarantee visa
• Storage of various raw documents on Azure Data Lake Storage
• Implementation of an Azure Service Bus cloud messaging system to connect the different application components
• Evolutions and bug fixes for the internal development framework
• Control and verification of identity documents and supporting documents via Jouve's SaaS solution
• Launch of KYC score calculation through the integration of a conformity matrix and querying other third-party databases
Stack Java 1.8 JEE, Spring (Boot, Data, Batch), Azure (Service Bus, Storage), Jira, JPA, SVN, Eclipse, Maven, SQL Server