About Mouhamad
English
Fluent
French
Native or bilingual
Experience
- Videotron CanadaSenior Data Engineer ConsultantTELECOMMUNICATIONSAugust 2020 - October 2021 (1 year and 2 months)Montréal, CanadaManagement of the Big Data platform and Data Lake- Administration of the Cloudera platform- Optimization and support of the development of ingestion pipelines for flows from suppliers with Kafka, Spark and NiFi- Design and development of the platform, including the decommissioning of HDFS in favor of S3- Industrialize batch jobs with Spark and with Kafka and Spark Streaming in real time modeTechnical environment: Hadoop|Spark|SparkSteaming|Hive|Oozie|S3|Kinesis|KafkaDecommissioning of the Cloudera platform to the Cloud (Databricks, Kafka Confluent, AWS, Snowflake)- Participation in the implementation of the new Cloud architecture- Migration of NIFI flows to Snowflake with Snowpipe- Migration of data from Hive to Snowflake- Rewriting Spark scripts, in particular to adapt them to Databricks (Delta Lake, Autoloader)- Use of AWS lambda to retrieve data from Kinesis and write it to Kafka confluentTechnical environment: Databricks|Spark|Spark Steaming|Deltalake|Snowflake|S3|Kinesis|Lambda|Kafka Confluent|Terraform
- ORANGEData EngineerTELECOMMUNICATIONSApril 2018 - April 2020 (2 years)Dakar, SenegalClient: Orange SenegalEvolution of a SAS BI platform to a Big DATA Hadoop HDP platform- Technical lead and choice of tools- Migration of all SAS scripts to Spark/Scala, storage management in Hive and job scheduling with Oozie- Supervision of data feed jobs with ELK and Grafana- Development of a Kpi Engine which allows, from a configuration file, to generate KPi for the business without coding- Implementation of new use cases (Fraud, Location, Relational circle, Turnover…)- Implementation of the IC/DC pipeline and code review- Training and skills development of the team (Background in Business Intelligence)Technical environment: Hadoop|Spark|Scala|Hive|Oozie|ELK|GrafanaImplementation of a Datalake- Analysis of business needs with the product owner and choice of appropriate tools- Implementation of the data acquisition pipeline with NiFi- ETL to extract and enrich data with Hive and Spark- Scheduling of data processing with Oozie- Supervision of data flow processing with ELK and Grafana- Handling anomaliesTechnical environment: NiFi|Hive|Spark|Oozie|ELK|Grafana- Implementation of a fraud detection and revenue assurance system- Technical lead (02 Data Engineer, 04 Full stack, 01 Ops) and choice of tools- Analysis of business needs with the Product Owner- Implementation of real-time data acquisition with Kafka and Spark- Implementation of data analysis models with Spark- Storage of results with HBase- Implementation of the IC/DC pipeline and code review- Handling anomalies
- DevoteamData EngineerDIGITAL AND ITJanuary 2018 - April 2018 (3 months)Paris, FranceClient: HSBC- Implementation of a Big Data platform for retail banking at HSBC- Implementation of the hybrid Big Data HDP + GCP platform- Implementation of the detailed architecture of the solution with DataProcTechnical environment: Hortonworks|GCP|DataProc
Recommendations
Be the first to recommend Mouhamad
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Engineer diploma - Big DataEFREI PARIS2015Majeure en Big Data
Certifications
- Databricks Certified Associate Developer for Apache Spark 3.0Databricks2021