Freelancer profile translated to English.
Back to original languageAbout Adel
Senior Developer Java / Big Data with over 10 years of experience
An engineer specializing in Big Data and Java technologies, I have been supporting companies for over a decade in the design, development, and optimization of large-scale data processing solutions.
My expertise covers the entire data processing chain: ingestion, transformation, analysis, and exposure, in a distributed environment.
🔧 Key Skills:
- **Hadoop**: **HDFS**, **YARN**, MapReduce, integration with Spark
- Spring / Spring Boot: microservices, REST APIs, Spark job integration
- Distributed ecosystems: **S3**, HDFS, **Hive**, **Kafka**, SQL/NoSQL
💼 Accustomed to demanding environments (large volumes, performance constraints, **CI/CD**), I offer robust, scalable, and well-structured solutions.
📍 Available for Big Data development missions, Spark optimization, cloud migration, or setting up complete data pipelines
French
Native or bilingual
English
Fluent
Arabic
Native or bilingual
Can work on-site
Paris (up to 50km), Lyon (up to 50km), Grenoble (up to 50km)
Experience
- AdobisGroupBig Data Spark / Java EngineerSeptember 2024 - Today (1 year and 11 months)Grenoble, FranceAs part of the DataChain project, I led the redesign and optimization of a core massive data processing module, focused on batch operation usingApache**Spark** and **Hadoop**, deployed on a **standalone or Yarn/Hadoop cluster**. The main objective was to make the pipelines more reliable, improve their **performance**, and make them more adaptable to different data volumes and formats. The main areas of work include:
- Analysis of the existing architecture and identification of critical points impactingSpark jobsperformance.
- Development of new features to improve the scalability and efficiency ofSpark batchprocessing.
- Implementation ofautomated and generic teststo systematically validate functionalities and ensure the quality of transformations.
- Design ofperformance testscripts to measure, compare, and optimize job execution times based on volume, format, and storage system used.
- Complete integration ofS3internal storage mode into the processing module: comparative performance study (local, **HDFS**, S3), adaptation of the existing abstraction logic, implementation, and validation through functional and performance tests.
- Configuration of reproducible test environments, orchestration of services for integration tests.
- Added support for newfile formats(Excel, Xml, etc.).
- Upgrade toSpark 3.5.xand update of auxiliary frameworks.
- Enedis - LyonData Developer / Spark / ScalaENERGY AND UTILITIESSeptember 2022 - October 2023 (1 year and 1 month)Lyon, FranceDesign, development, and optimization of data processing pipelines for the **Enedis communication chain**, in a **Big Data environment (Hadoop, Spark, Scala, Hive)**.Tasks performed:
- Development of distributed processing pipelines withSpark and Scalaon **Hadoop/HDFS/Hive**.
- Integration and transformation of raw data from heterogeneous sources (Linky meters, mass markets, business markets).
- Implementation ofREST APIs in Java Springto expose data to various business stakeholders.
- Maintenance ofcontinuous integrationpipelines with **Jenkins**.
- Writingtechnical documentationand user guides.
- Monitoring of functional and technical evolutions, with continuous updating of processing.
- ConductingPOCsto test new solutions or technological approaches.
- Development and maintenance of unit and integration tests.
- Adobis GroupSpark / Java Developer EngineerSOFTWARE PUBLISHINGApril 2017 - July 2022 (5 years and 3 months)Grenoble, FranceIn collaboration with the project team, I am developing aBig Datasolution based on open-source technologies such asJava,**Spring**, **Spark**, and **Docker**.The solution provides a set of technical modules for integrating data from various sources (files, databases, http, etc.) and structuring it according to user needs. It also includes a powerful functional component for orchestrating, analyzing, exploring, and visualizing this data in real-time. The main areas of work include:
- Participation in requirements analysis workshops
- Development (in **Java and Scala**) of Spark jobs for data integration and in-memory loading.
- Development ofRESTservices in Java/**SpringBoot**/Hibernate.
- Securing the various modules based onOAuth2/OpenIdandKeycloakprotocols using theSpring Securityframework.
- Configuration ofDockerimages.
- Development ofGroovyscripts for database upgrades.
- Evolutions and corrections: analysis, design, and development.
- Configuration ofCI/CD pipelinesin **Gitlab**.
- Development of unit tests withJunitand **Mockito**.
Recommendations
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- National Engineering Diploma in Computer ScienceNational Engineering Diploma in Computer Science - National Engineering School of Tunis, Tunisia2012