Sara Hemmi

Level 3 support and administration of Cloudera clusters in production, hotline, and on-call duties.

Support and onboarding of new projects on the Big Data platform, rapid ticket resolution.

Deployment and integration of Starburst on Openshift, integration of Ranger for permissions management, optimization of dynamic catalogs and WarpZSpeed Caching.

Definition of target architecture and design of data models optimized for performance and governance.

Supervision of pipelines and platforms, ensuring data security, compliance, and quality.

Support for technical and business teams in implementing solutions.

Maintenance and technical monitoring of a Big Data platform used by a team of data scientists. Ensuring the design and maintenance of data flows, processing, storage, and preparation of data in close collaboration with data scientists and automating workflows to improve operational efficiency.

• Maintenance and support of a Big Data platform composed of Spark, MinIO, Jupyter, and Airflow deployed on Openshift.

• Design, development, and maintenance of data pipelines: to enable efficient acquisition, processing, storage, and availability of data from various internal and external sources.

• Data integration: ensuring coherent data centralization from multiple sources to enable a unified view of information and facilitate cross-functional analysis for business teams.

• Data quality and reliability: implementing rigorous validation controls and data cleaning mechanisms to ensure the quality, consistency, and reliability of data used in reports and analyses.

• Continuous monitoring and maintenance of pipelines to quickly detect and resolve incidents, thereby minimizing downtime and ensuring constant data availability.

• Data security to ensure the reliability of sensitive data in accordance with company privacy and compliance policies.

• Process automation for repetitive tasks to increase operational efficiency.

• Providing comprehensive documentation of data pipelines, schemas, and workflows to facilitate team collaboration and communication. ENVIRONMENT: Openshift, MinIO, Spark, PySpark, Jupyter, Airflow.

Level 3 support. Administration of Hadoop and Elasticsearch clusters. Maintenance of Hadoop and Elasticsearch clusters. Implementation of a centralized supervision system for Hadoop and Elasticsearch clusters. Study, proposal, implementation, and support of projects in their technological choices: understanding business challenges and data needs (usage and management) to integrate them into existing technical infrastructures. HBase migration and backup project: proposing a new, more performant architecture that best meets project needs. HDP 2.6 to CDP Base 7.x Migration

- Study of the new platform: Benchmarking of different form factors (CDP Public and Private Cloud). Participation in the creation of the architecture document and detailed specifications for the deployment of CDP 7.x (definition and distribution of components by node type, normalization of specific configurations: HA…)

- Participation in the implementation of the new platform (prerequisites, installation, and post-installation configuration)

- Technical qualification of new components (Cloudera Manager…)

- Technical qualification of updated components (deprecation, new features: Hive2 vs Hive3…)

- Functional impact study and support for projects in migrating their application code. Data Governance

- Participation in studies for choosing the solution to implement (Microsoft Azure Purview, Amazon EMR, Cloudera Data Catalog…)

- Qualification and implementation of Apache Atlas.

- Design of a "security by design" model for accessing the bank's data assets:

- Define the type and role of Data Catalog profiles.

- Secure access for the Data Catalog for:

- Access to the ATLAS UI.

- Data access.

- Strengthen security for access to the above UIs, especially for privileged roles, with two-factor authentication.