Freelancer profile translated to English.
Back to original languageAbout Maxime
You can find my availability on my website:
🚀 Passionate about data and engineering, I am a Data Engineer, Spark Expert with solid experience in the field. I am also a trainer in my spare time, mainly on Kafka. I work remotely or asynchronously via the e-learning platform Udemy.
🔧 My technical skills include a thorough mastery of Spark, Scala and Java, as well as knowledge of AWS environments (S3, EMR, Athena, RDS), databases (MySQL, PostgreSQL, Teradata, Hbase, Hive, MSSQL, MongoDB), Kafka, Oozie, Linux, Jenkins, GitLab CI/CD, Airflow, Sharepoint and more. I am familiar with agile methodologies such as Scrum and Kanban, and I constantly strive to stay up-to-date with the latest technologies and trends in data engineering.
🔍 If you are looking for a versatile professional, passionate about technical challenges and with solid experience in data engineering, do not hesitate to contact me. I am always open to opportunities for collaboration and sharing expertise in the exciting field of data
English
Fluent
Chinese
Basic
French
Native or bilingual
Can work on-site
Nantes (up to 50km)
Experience
- Credit Agricole Technologies et ServicesData Engineer, Spark Technical ExpertBANKING AND INSURANCEJanuary 2023 - February 2024 (1 year and 2 months)Nantes, France-> Within the Data Base team: Design, Develop, Test, Deploy and ensure the RUN and support of the internal Spark facilitator at CA-TS• Spark• Java• Yarn• Various databases: MySQL, PostgreSQL, Teradata, Hbase, Hive, MSSQL, Mongo ...• Kafka• Rest Api-> Build, run, architecture and design support to the various CA-TS teams (on the tool and on the big data platform)-> Scheduling: Oozie, workflow creation-> Spark job optimization.-> Writing technical documentation, xWiki script.-> Training, skills development and good practices for the various collaborators on the big-data platform.-> Improve the stability, scalability and performance of Data projectsTechnical Environment:Cloudera, Spark 2.4.4/3.2.2, Java 8/11, Hadoop, Kafka, Oozie, Linux, jenkins, Gitlab CI/CD, Xwiki documentation, Git, Intellij Agile method: Scrum
- MymoneybankData Engineer AWS/Big DataBANKING AND INSURANCEJuly 2020 - January 2023 (2 years and 6 months)Nantes, France-> Within the Data publishing team: Design, Development, Testing, Deployment and ensuring the RUN of various data flows and applications in order to produce operational reports.• Spark• Scala• Yarn• Postgresql• AWS: S3, EMR, Athena, RDS, Glue• Excel-> Continuous integration: Gitlab CI/CD.-> Scheduling: Airflow / Python, DAG creation.-> Spark job optimization.-> Support to the various Spark teams: job optimization, debugging, good development practices, unit tests.-> active participation in the development of common MMB libraries.-> Excel report creation.-> JAVA batch creation: Java / Spring.-> Writing technical documentation.-> Challenge the functional mapping of data.Technical Environment:AWS: S3, Athena, EMR, RDS, System Manager. Spark 2.6/3.1.1, scala/Java 8/11/14/17, gitlab Ci/CD, Kibana, Airflow, Sharepoint, Agile method: Scrum/Kanban
- SopraSteriaData EngineerPUBLIC SECTORMarch 2018 - July 2020 (2 years and 4 months)Nantes, FranceAs part of a POC (Proof Of Concept) / implementation of a Big Data sector at CNAM:-> Design, Develop, Document, Test and put into production various flows to feed a data lake:• Spark streaming• Batch Spark• Kafka - kafka connect, custom SMT / Avro + Schema registry• flow nifi, nar custom-> Development in a secure environment: Knox, Ranger, Kerberos...-> Participation in the configuration of Spark, Hadoop, NiFi, YARN machines...-> Setting up a Local development environment (Docker, Git, Hortonworks).-> linux/yarn/hadoop scripts: Launching, deployment of applications-> Hive Scripts-> Grafana dashboard creation-> Continuous integration: Jenkins / Git-> Data governance with Atlas-> Agile methodology: SCRUM.Technical Environment:Hortonwork ecosystem (Hadoop, Hdfs, YARN, Spark, Kafka, Nifi, Zookeeper, Hive, Ambari)Avro confluent, Java 8, Linux, Jenkins, Git, Docker, confluent
Recommendations
Be the first to recommend Maxime
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Master 2 research Computer science - decision-making intelligenceUniversity of Angers2017Optimisation combinatoire : Méta-heuristiques , recherche tabou , algorithme génétique , Algorithmes Auto-Adaptatifs, apprentissage par renforcement, Multi-objective optimization, branch and bound , glouton, programmation par contrainte , glpk/glpsol ... Bio-Informatique : utilisation de Méta-heuristiques pour la construction d'arbres phylogénétique machine learning, deep learning , réseaux de neurone, arbre de décision, Réseau bayésien ... Logique : machine de turing, QBF, FNC/FND , forme prenexe et pleins d'autres ... Fouille de Données Bases de Données Avancées Ingénierie de l'Optimisation Modèles et Outils Avancés de Programmation Systèmes à Base de Connaissances et Interaction Représentation des Connaissances et Raisonnements Traitement de la Langue et Recherche Documentaire
Certifications
- Spark Fundamentals IIBM Cognitive Class2018