Freelancer profile translated to English.

Back to original language

Description

Admin Hadoop (3 years of experience) Société Générale

Several projects that allowed me to gain expertise in administering Hadoop clusters, whether Hortonworks or Cloudera.

If I had to list keywords and projects carried out during these 3 years:

- Installation of a lambda architecture (Batch + streaming parallelization)

- Installation and tuning of an ELK platform (Elasticsearch, Logstash, Kibana)

- Build and MCO of several HDP 2.6.X clusters (approximately 400 nodes)

Keywords based on real experience in order of expertise:

HDP Stack (HDFS, Yarn, MapReduce, Ranger, Oozie, Zookeeper, etc...)

Spark Streaming, Kafka, Nifi

UNIX System, RHEL, CentOS, Windows

Spotfire, Qlik, Kibana.

Ansible, shell, Python, Spark

Control-M

Github, Jira, Trello

Languages

French
Native or bilingual
English
Fluent

Workplace preferences

Can work on-site

Paris (up to 50km), Vernouillet (up to 50km)

STET
DataOps Administrator
October 2020 - Today (5 years and 8 months)
Within an infra team:
• Installation from scratch of kerberized + TLS CDP 7.1.7 & CDH 6.3.3 clusters.
• Installation of a backup cluster, disaster recovery using distcp.
• Migration of CDH 6.3.3 cluster ➔ CDP 7.1.7 SP2
• Setting up Cloudera prerequisites system/network via ansible.
• Setting up anti-fraud middleware for machine learning purposes. (This is a layer composed of a set of middleware, with CDP clusters as its foundation, mainly for training models via spark/python)
• Cluster security management Kerberos, Ldap, Ranger and Ranger KMS
• Optimization of Big Data cluster components Yarn (preemption), Spark, NIFI
• Problem management (Run, MCO)
• Analyze, Manage, Oversee changes
• Installation and management of external services: Nexus, IDM, Hashicorp vault Technical Environment: Ansible, Python, Jupyter Lab, Git, Jenkins, Docker, Nexus, HDP/HDF, Cloudera, Kerberos, Ldap, Ranger, Ranger KMS, Kubernetes, Yarn, Knox, Hive, Nifi,.
Société Générale
DataOps Administrator
August 2018 - October 2020 (2 years and 2 months)
Within a Big Data competence center
• Administration of Big Data clusters with Ansible and Ambari HDP/HDF or Cloudera
• Cluster security management Kerberos, Ldap, Ranger and Ranger KMS
• Setting up a data pipeline for BI tools from a Big Data cluster Knox, Hive, WebHCat, WebHDFS
• Optimization of Big Data cluster components Yarn, Knox, Hive, NIFI
• Problem management (recurring incidents with medium/long-term action plan)
• Analyze, Manage, Oversee changes
• Ensure maintenance of application platforms: Creation and administration of environments, application of patches, supervision, backups, job scheduling, data flows, metrology, technological watch.
• Write operating manuals: installation, procedures, architecture, DRP. Technical Environment: Ansible, R, Rstudio Server, Shiny Server, Python, Anaconda, Jupyter Hub, Git, Jenkins, Gradle, Docker, Nexus, ML Flow, HDP/HDF, Cloudera, Kerberos, Ldap, Ranger, Ranger KMS, Kubernetes, Yarn, Knox, Hive, Nifi, Syslog, Audit.d
Société Générale
Streaming Integration Engineer
December 2017 - August 2018 (8 months)
Within the Société Générale Big Data streaming Feature team
• Maintenance in operational condition of Elasticsearch, Logstash, Kibana clusters
• Setting up infrastructure supervision via Kibana, Nagios.
• Incident management (recurring incidents with medium/long-term action plan)
• Analyze, Manage, Oversee changes.
• Ensure maintenance of application platforms: Creation and administration of environments, application of patches, supervision, backups, job scheduling, data flows, metrology, technological watch.
• Write operating manuals: installation, procedures, architecture. Technical Environment: Shell, ansible.