You're seeing this page as if you were . The main menu is still yours, though. Exit from immersion
Ilias L.IL

Ilias L.

Data Engineer Spark Scala PySpark Python

€600/day
Paris, FR
3-7 years

Average response time: 1 hour

Freelancer profile translated to English.
Back to original language

About Ilias

Data Engineer with 6 years of experience in designing and developing Big Data solutions, involved in high-stakes projects.

Specializing in Spark (Scala / Python), I design and develop robust and efficient data pipelines, from ingestion to business delivery, in Hadoop / Cloud environments.

Accustomed to demanding contexts (banking, regulatory, finance...), I work on greenfield developments, technical redesigns, performance optimizations, and platform migrations.

Autonomous, rigorous, and results-oriented, I integrate easily into agile teams and am comfortable with complex and critical subjects.

Curious and adaptable, I remain open to all business sectors, as long as the data stakes are high and the technical challenges are stimulating.
  • French

    Native or bilingual

  • English

    Fluent

Can work on-site
Paris (up to 50km)

Experience

  • BoursoBank
    Data Engineer
    BANKING AND INSURANCE
    March 2023 - February 2026 (2 years and 11 months)
    92100 Boulogne-Billancourt, France
    "Data Hub" Project: Development of Big Data Applications (Risk-Finance, Compliance, Fraud, Marketing…)

    • Development of operational processes and procedures
    • Analysis, clarification, and determination of needs
    • Collection of raw data via feeds (CIS, CRM, Stock Market…)
    • Creation of golden sources for the Big Data foundation
    • Development of new applications and redevelopment of existing ones
    ➢ Exploitation and in-depth data analysis
    ➢ Implementation of data processing flows
    ➢ Implementation of new scenarios, KPIs, new features…
    ➢ Performance optimization (Spark resources, code…)
    • Migration of projects to a new platform: Airflow
    • Refactoring of old projects (rewriting, restructuring, and code optimization)
    • Upgrades following BCE audits
    • Integration of tests (unit, end-to-end, functional, non-regression…)
    • Adherence to development standards and security of sensitive data
    • Documentation maintenance (project sheets, production releases, technical issues…)
    • Production releases, MCO (Maintenance in Operational Condition) and RUN management
    • Responsible for major applications of the Big Data foundation

    Technical Environment:Scala, Python, Spark/PySpark, Hadoop, Hive/SQL, Git, Airflow, Jenkins, Shell, Hue, Zeppelin, Nifi, SonarQube, Jira, Agile Methods
    Spark Scala Python Hadoop Airflow
  • AXA
    Data Engineer
    BANKING AND INSURANCE
    September 2022 - February 2023 (5 months)
    Nanterre, France
    "Data, Tech & Forecast Monitoring" Project: Development of Big Data applications to feed a datalake, which is the central data source for AXA's Investment Department.

    • Design and development of robust data pipelines to improve the availability and reliability of critical data for business teams
    • Implementation of distributed processing for large volumes of data
    • Setup and orchestration of data processing workflows (scheduling, dependencies, monitoring)
    • Development of Python scripts for data ingestion, transformation, and validation
    • Optimization of processing performance through PySpark job optimization on Databricks and cost reduction
    • Data modeling and manipulation in SQL
    • Integration of data from multiple sources (APIs, databases, flat files…)
    • Implementation of good development practices (versioning, CI/CD, code quality…)
    • Collaboration with business teams to understand needs and propose suitable data solutions
    • Participation in the monitoring and maintenance of data pipelines in production

    Technical Environment: Python, PySpark, Microsoft Azure, Databricks, Git, SQL, Shell, Azure DevOps, Agile Methods
    PySpark Python SQL Databricks Microsoft Azure
  • La Poste BSCC
    Data Engineer
    TRANSPORTATION
    September 2020 - August 2022 (1 year and 11 months)
    La Défense, France
    "Big Data Analytics" Project: Development of Big Data Applications (Fraud, Customs, Press…)

    • Participation in the technical architecture design of projects
    • Proposal of processes and operating methods
    • Support for needs assessment
    • Development and deployment of Big Data applications within the Datalake
    ➢ Ingestion of various types and sources of data
    ➢ Data exploration and analysis
    ➢ Pipeline construction (data cleaning, preparation, and transformation)
    ➢ Development of new project features
    ➢ Data availability on the Datalake
    ➢ Performance optimization
    • Integration of tests (unit, functional…)
    • Application of development best practices and encryption of personal data
    • Documentation writing (operational guide, server installation manual…)
    • Production release and maintenance in operational condition of applications
    • Responsible for major applications of the Big Data foundation

    Technical Environment:Scala, Python, Spark/PySpark, Hadoop, Git, Jenkins, Hive/SQL, Shell, Bash, Kafka, Dataiku, SonarQube, Jira, Agile Methods
    Spark Scala Python Hadoop Microsoft Azure

Recommendations

Be the first to recommend Ilias

Help this freelancer shine by sharing your experience working together.

These freelancer profiles also match your criteria

AgathaA

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

2

BaptisteB

Baptiste Duhen

Fullstack developer

4.6

(4)

5

AmedA

Amed Hamou

Senior Lead Developer

4

(2)

7

AudreyA

Audrey Champion

Web developer

4.3

(3)

4

Education

  • Master
    Efrei Paris – Engineering School of IT
    2021
    Master Big Data & Machine Learning, effectué en anglais
  • Academic exchange
    Staffordshire University
    2018
    Academic exchange, Computer Science

Skill set

Categories