Freelancer profile translated to English.
Back to original languageAbout Anass
👨💻 Freelance Data Engineer | Spark, PySpark, Snowflake, DBT Databricks, AWS, GCP, Talend
As a Data Engineer specializing in cutting-edge technologies such as Spark, PySpark, DBT, Snowflake, Talend, Databricks, AWS, and GCP, I am committed to helping you maximize the value of your data to make informed decisions.
✨ Designing robust data collection pipelines from diverse sources.
🔄 Utilizing Spark and PySpark for complex transformations, ensuring data quality and consistency.
📊 Designing optimized data models for efficient structure and access.
🛠️ Designing flexible ETL jobs with Talend to meet your specific needs.
🌐 Harnessing the power of distributed computing with Spark to process massive data volumes efficiently.
⚙️ Implementing parallel processing algorithms for optimal performance.
☁️ Proficient in using Databricks for cloud data management and analysis, ensuring maximum scalability.
🚀 Implementing advanced optimization strategies for fast processing times and exceptional performance.
🔐 Ensuring data security in compliance with current regulations.
🤖 Automating data management processes to minimize errors and optimize efficiency.
📖 Rigorous documentation of data pipelines and ETL processes for easy maintenance.
📊 Creating interactive reports and dashboards to visualize trends and insights.
👥 Collaborating closely with business teams to understand their data needs and translate them into technical solutions.
🗣️ Ability to communicate effectively with technical and non-technical stakeholders.
French
Native or bilingual
English
Fluent
Arabic
Native or bilingual
Remote only
Primarily works remotely
Experience
- CHRONOPOSTData EngineerLOGISTICS AND SUPPLY CHAINSeptember 2022 - September 2023 (1 year and 1 month)Paris, France- Developed Spark batch and Hive QL jobs.- Tuned performance and optimized Spark batch jobs.- Snowflake POC: Exported and generated data in Snowflake to replace Teradata.- Monitored Hadoop cluster - Ambari (created Yarn queues, added parameters for automatic Spark log purging).- Data modeling.
- FNAC DARTYData EngineerJanuary 2022 - September 2022 (8 months)Paris, France- Processed Talend flows in ELT mode.- Populated the Data Warehouse with stock data.- Wrote technical parts of specifications (Mapping, interface contract, and loading strategy).- Tested migration from MapR to GCP. Project Name: Data Stock Foundation / Data Hub Implementation. Technical Environment: Talend, Talend ELT, Teradata, GCP (Cloud Storage, BigQuery), SQL, JIRA, GIT.
- Informatique et Technologies - Caisse d'EpargneData EngineerDecember 2020 - January 2022 (1 year and 1 month)Paris, France- RECO19 project: removing all DCPs from the BigData platform.- Responsible for populating the ITCE Data Lake for use case needs.- Prepared configuration files and launch scripts.- Investigated production incidents.- Performed PySpark transformations in the AWS Glue service for ETL.- Made tables available in Redshift. Technical Environment: Hadoop, HDFS, Hive, Hbase, PySpark, AWS (RDS, Glue, S3), VTOM, Grafana, Oracle, Shell.
Reviews
No review details to display
Anass has chosen to keep their written reviews private.
Recommendations
Be the first to recommend Anass
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Master MIAGE in Work-Study Program, IT Project Engineering - New TechnologiesUniversité de Lille - sciences et technologies2020Master MIAGE en Alternance , Ingénierie de Projets Informatiques - Nouvelles Technologies
- Bachelor's degree, Computer Programming, Specific ApplicationsUniversité de Lille - sciences et technologies2018Licence, Programmation informatique, applications spécifiques
Certifications
- Big Data Essentials: HDFS, MapReduce and Spark RDDCoursera2020