Freelancer profile translated to English.
Back to original languageAbout Mohamed
I am Mohamed Amrani, an engineer specializing in data flow integration and management, with in-depth expertise in Apache NiFi. I have extensive experience in designing, deploying, and optimizing data pipelines, ensuring robust and scalable solutions across various cloud environments, including AWS, Azure, and GCP.
With my strong expertise in data engineering and real-time stream processing, I develop high-performing, secure, and optimized workflows. Passionate about automation and system optimization, I adopt a pragmatic approach to solve complex data management challenges and ensure reliable and efficient flows.
Autonomous and a quick learner, I also work comfortably within multidisciplinary teams. My commitment to continuous learning and my attention to detail enable me to propose innovative and high-quality solutions in every project I undertake.
French
Native or bilingual
Arabic
Native or bilingual
English
Fluent
Can work on-site
Paris (up to 50km)
Experience
- BNP ParibasApache NiFi ExpertBANKING AND INSURANCEDecember 2023 - Today (2 years and 6 months)Paris, FranceDevelopment and optimization of complex NiFi flows for ingestion, transformation, and integration in distributed environments, reducing latency and enhancing scalability.• Design and optimization of SQL queries for ETL to SQL Server, ensuring performance and data consistency.• Extension of NiFi functionalities via Python (processors and scripts) to automate and enrich workflows.• Fine-tuning of workflows (configuration, memory, threads) to maximize throughput and reduce resource utilization.• Migration of chaotic pipelines to a structured architecture, improving maintainability, execution speed, and scalability.• Automated deployment of NiFi flows via Jenkins to ensure consistency and accelerate production releases, with version management using Apache NiFi Registry.• Implementation of a synchronization architecture between pipelines, ensuring execution order and insertion into target tables.• Configuration of monitoring dashboards for real-time visibility into flow status.• Guarantee of high availability through clustering strategies, load balancing, and continuous failure monitoring.• Resolution of NiFi incidents with rapid diagnosis and effective corrective actions.• In-depth analysis of root causes and impacts, with implementation of solutions to limit interruptions.• Cross-team collaboration to collect data, analyze incidents, and propose preventive measures.
- CARREFOURApache NiFi ExpertAGRICULTUREApril 2021 - December 2023 (2 years and 8 months)Massy, FranceApache NiFi• Automation of installation and deployment via Ansible: development of roles and playbooks ensuring consistent configuration across various environments.• Design of complex flows in NiFi for data processing, transformation, and integration, optimizing performance and reliability.• Functional extension of NiFi using Python: creation of custom processors, extensions, and automation scripts to streamline tasks.• Training and mentoring of junior team members on best practices and platform usage.• Performance testing and optimization of NiFi workflows, improving throughput and reducing latency.• Successful migration of Tibco data flows to NiFi, ensuring a more scalable and flexible platform.• Implementation of real-time monitoring via ElasticSearch for alerts and efficient troubleshooting.• Configuration of comprehensive dashboards with Kibana and Grafana for visual performance analysis and bottleneck identification.• SRE responsibilities: ensuring high availability, performance optimization, and rapid incident resolution.Apache Kafka• Development of operational scripts for Kafka including mirroring scripts for inter-cluster duplication, dynamic topic creation, and automated connector configuration for seamless data integration.• Implementation of the RabbitMQ connector on Kafka to effectively integrate the RabbitMQ messaging system and facilitate event-driven architectures.• Design of a RESTful web service with SpringBoot to interact with Kafka, providing a user-friendly and standardized interface for managing topics, configurations, and messaging operations.Incident Resolution and Analysis
- MediaCaris®Data EngineerTECHJune 2020 - April 2021 (10 months)Tanger, Morocco• Development of a complete web application for flow tracking, real-time monitoring, processing administration (stop, restart, alerts), and deliverable generation.• Advanced monitoring of RabbitMQ, with the implementation of tools ensuring reliable and efficient message management.• Automation via Ansible for the installation and administration of tools on GCP VMs, simplifying deployment and maintenance.• Execution and maintenance of Playbooks, ensuring automation of recurring tasks and infrastructure stability.• Design of Apache NiFi workflows, optimizing flows and data processing.• Development of Spark applications in Python, leveraging the distributed engine for advanced data processing.• Real-time data streaming with Spark, offering real-time analytics and increased responsiveness.• Writing clear technical documentation, covering installation and operation for effective knowledge transfer.• Rapid incident analysis and resolution, with root cause identification and implementation of preventive solutions.
Recommendations
Be the first to recommend Mohamed
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- IoT Cloud Developer - Mastery2019IoT Cloud Developer - Mastery
- Java SoloLearn certification IBM Certified Data Engineer - Big DataJava SoloLearn certification IBM Certified Data Engineer - Big Data