You're seeing this page as if you were . The main menu is still yours, though. Exit from immersion
Ilias L.IL

Ilias L.

Data Engineer Spark Scala PySpark Python

€600/day
Paris, FR
3-7 years

Average response time: 1 hour

Freelancer profile translated to English.
Back to original language

About Ilias

Data Engineer with 7 years of experience in designing and developing Big Data solutions, involved in high-stakes projects.

Specializing in Spark (Scala / Python), I design and develop robust and performant data pipelines, from ingestion to business delivery, on Hadoop / Cloud environments.

Accustomed to demanding contexts (banking, regulatory, finance...), I am involved in greenfield developments, technical overhauls, performance optimizations, and platform migrations.

Autonomous, rigorous, and results-oriented, I integrate easily into agile teams and am comfortable with complex and critical subjects.
Curious and adaptable, I remain open to all sectors of activity, as long as the data stakes are high and the technical challenges are stimulating.
  • French

    Native or bilingual

  • English

    Fluent

Can work on-site
Paris (up to 50km)

Experience

  • BoursoBank
    Data Engineer
    BANKING AND INSURANCE
    March 2023 - February 2026 (2 years and 11 months)
    92100 Boulogne-Billancourt, France
    "Data Hub" Project: Design and evolve the Big Data platform for large-scale data collection, processing, and**provisioning for business needs (Risk-Finance, AML-CFT Compliance,**Fraud, Marketing...).

    • Development of operational processes and procedures
    • Analysis, clarification, and determination of needs
    • Collection and integration of raw data from multiple sources (CIS, CRM, Stock Exchange...)
    • Creation of golden sources and implementation of Data Quality controls for the Big Data foundation
    • Development of applications from scratch and takeover of existing applications
    ➢ Data exploitation and in-depth analysis
    ➢ Implementation of data processing flows
    ➢ Integration of new scenarios, KPIs, new features...
    ➢ Performance optimization (Spark resources, code...)
    • Development of common libraries for applications
    • Industrialization of deployments via CI/CD pipelines
    • Migration of projects to a new platform: Airflow
    • Migration from Spark 2 to Spark 3
    • Refactoring of old projects and legacy applications (rewriting, restructuring, and code optimization)
    • Upgrades following ECB audits
    • Integration of tests (unit, end-to-end, functional, non-regression, double run...)
    • Adherence to development standards and sensitive data security (GDPR)
    • Documentation maintenance (project sheets, data lineage, incidents and technical problems...)
    • Production deployment, operational maintenance (MCO), and monitoring of applications and the Big Data platform
    • Technical referent for several strategic applications of the Big Data foundation

    Technical Environment:Scala, Python, Spark / PySpark, Hadoop Cloudera, Hive / SQL, HDFS, Airflow, Git, Jenkins, Shell, Hue, Zeppelin, Nifi, Nexus / Jfrog, Grafana, SonarQube, Jira / Confluence, Agile Methods
    Spark Scala Python Hadoop Airflow
  • La Poste BSCC
    Data Engineer
    TRANSPORTATION
    September 2020 - February 2023 (2 years and 5 months)
    La Défense, France
    "Big Data Analytics" Project: Design, develop, and enhance the Big Data platform centralizing operational data from activities by developing Big Data applications (Fraud, Customs, Press...).

    • Participation in the design of the technical architecture of projects
    • Proposal of processes and operating methods
    • Support for requirements scoping
    • Development and deployment of Big Data applications within the Datalake
    ➢ Ingestion of different types and sources of data
    ➢ Data exploration and analysis
    ➢ Pipeline construction (data cleaning, preparation, and transformation)
    ➢ Development of new project features
    ➢ Data provisioning on the Datalake
    ➢ Performance and resource optimization
    • Migration of projects from Hadoop to Microsoft Azure and Databricks
    • Industrialization of deployments via CI/CD pipelines
    • Integration of tests (unit, functional, double run...)
    • Good development practices and encryption of personal data (GDPR)
    • Documentation writing (operational file, server installation manual, data mapping...)
    • Production deployment and operational maintenance (MCO) of applications
    • Responsible for major applications of the Big Data foundation

    Technical Environment:Scala, Python, Spark / PySpark, Hadoop Cloudera, Microsoft Azure, Databricks, Hive/SQL, Azure DevOps, Git, Jenkins, HDFS, ADLS, Shell, Bash, Kafka, Dataiku, Nexus, SonarQube, Jira / Confluence, Agile Methods
    Spark Scala Python Hadoop Microsoft Azure
  • AMF (Autorité des Marchés Financiers)
    Data Engineer
    BANKING AND INSURANCE
    September 2019 - August 2020 (11 months)
    2nd arrondissement, 75002 Paris, France
    "ICY" Project: Design, develop, and maintain solutions for collecting, processing, and analyzing financial data. The objective is to strengthen market supervision and facilitate the use of regulatory data for control and investigation purposes.

    • Taking over and analyzing the project's existing setup
    • Study of development standards
    • Ingestion of different types and sources of data
    • Data exploration and analysis
    • Pipeline construction (data cleaning, preparation, and transformation)
    • Development of new project features
    • Populating datasets in the Datalake for Business and Data Science uses
    • Automation of deployments and continuous integration (CI/CD)
    • Data extractions and analyses for business units
    • Code quality analysis
    • Monitoring of applications in production

    Technical Environment:Python, PySpark, Hadoop Cloudera, HDFS, Hive/SQL, Git, Jenkins, Hue, Zeppelin, Nexus, ELK (Elasticsearch / Logstash / Kibana), Grafana, Shell, SonarQube, Jira / Confluence, Agile Methods
    Spark Python Hadoop Git SQL

Recommendations

Be the first to recommend Ilias

Help this freelancer shine by sharing your experience working together.

These freelancer profiles also match your criteria

AgathaA

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

2

BaptisteB

Baptiste Duhen

Fullstack developer

4.6

(4)

5

AmedA

Amed Hamou

Senior Lead Developer

4

(2)

7

AudreyA

Audrey Champion

Web developer

4.3

(3)

4

Education

  • Master
    Efrei Paris – Engineering School of Computer Science
    2021
    Master Big Data & Machine Learning, effectué en anglais
  • Academic exchange
    Staffordshire University
    2018
    Academic exchange, Computer Science

Skill set

Categories