Farouk Imami

Server for uploading/downloading CSV files with model and data validation

Server allowing clients to upload configuration files or static tables themselves. : Python, Pytest, yaml, FastApi, Uvicorn, Docker, Jinja2 Paris Modification of CI/CD pipelines for data

Overhaul of the main pipeline for ETL updates, data retrieval, and client anonymization. Paris Design of the overhaul of the internal application for algorithm execution and overseeing the dev team to ensure architectural adherence

Overhaul of the main pipeline for ETL updates, data retrieval, and client data anonymization. : Technical specification, UML, POC POC with consumers/producers Python.

Energisme, Boulogne-Billancourt Development of Big Data pipelines and algorithms

Technical and managerial supervision (standardization, unit testing, etc.) of the development team on Spark (Scala), Python, and R.

Technologies : Scala Spark, Python, ETL (Amadea), Cassandra, ElasticSearch

Energisme, Boulogne-Billancourt Implementation of ETL pipelines and Python scripting

ETL (Amadea), data retrieval from Kafka, Cassandra, and ElasticSearch. Data transformation and preparation according to business needs.

Technologies : Python, Amadea, Powershell (Windows Server), Shell

Energisme, Boulogne-Billancourt (92) Functional specifications for an internal application for algorithm scheduling

Design of a software component allowing users to launch algorithm execution (Python, Java, R) via a REST API call. Design of a formula parser.

Technologies : UML, Conception, Confluence (Atlassian) Boulogne-Billancourt (92)

Design and POC for the revamp of the "Algorithm" product of the company, allowing clients to directly call an in-house developed algorithm directly from the front-end, asynchronously.

PoC made in Python and strimzi kafka on AKS, along with Keda for managing consumer and producers ressources according to the load of messages.

Shared the design documents and presentation with both the business side and technical side

Managed a team of 4 developers and data scientist to implement algorithms in Python and Scala-Spark.

Designed and implemented a Lambda architecture with Kafka, ElasticSearch, Cassandra, Spark and Phoenix/HBase