Description

I am a Data Engineer and AWS Certified Solutions Architect. I specialize in designing and implementing data solutions and in functional programming with Scala, Python, and particularly with Spark. I currently work for a company with its own platform, enabling clients to efficiently manage, analyze, and visualize large volumes of data. My daily tasks often include Data Acquisition, Data Orchestration, Data Development, Pipeline Automation, Data Cleaning, Data Migration, and Data Ingestion.

My extensive technical toolkit includes expertise in Scala, Python, Java, Spark, Flink, Kafka, Hive, Git, Docker, Kubernetes, AWS services (S3, EMR, ECS, DynamoDB, IAM), and SQL.

I take a meticulous and results-driven approach, focusing on delivering scalable, high-impact solutions that drive business growth and enhance decision-making capabilities.

Industry field of expertise

Languages

Spanish
Native or bilingual
English
Fluent

Workplace preferences

Remote only

Primarily works remotely

Big Data Company
Data Engineer
TECH
September 2022 - Today (3 years and 9 months)
Kingdom of Spain, Spain
Design and Implementation of the Informational Layer of an MDM (Master Data Management) System Utilizing a three-tier architecture (Frontend, Backend, and Informational) and a Medallion Architecture in a Data Lakehouse. This includes defining the format, structure, partitioning, and modeling of data across the system's layers, as well as managing the data lifecycle. Agile methodology was applied throughout the project.
Data persistence was implemented using Delta tables with versioning based on the SCD Type 2 model. The infrastructure was containerized using Kubernetes.
Data pipeline orchestration was managed with Apache Airflow, encompassing monitoring, incident resolution, and continuous optimization for performance improvements.

Tools and Technologies:
PySpark, Spark SQL, HDFS, AWS Services (S3, IAM), Delta Lake, Kubernetes, Git, Jenkins, Nexus, Jira.
Spark Spark Sql PySpark Scala Airflow AWS S3 EMR
Banking Company
Big Data Developer
BANKING AND INSURANCE
March 2020 - September 2022 (2 years and 6 months)
Madrid, Spain
Development and Optimization of Data Ingestion and Transformation Processes
Aligned with the bank's data model, including the modeling of tables with HQL structures. Conducted unit testing and ensured continuous integration across different layers with a code quality validator. Kanban methodology was applied.

Tools and Technologies:
Scala, Spark, Spark SQL, HDFS, Hive, ScalaTest, Git, Jenkins, Nexus, Jira, Sonar.

Real-Time Data Processing Developer in a Banking Sector Project
Focused on processing and transforming operations in real-time. Performed end-to-end (E2E) and unit testing, with continuous integration across different layers, including a code quality validator. Scrum methodology was utilized.

Tools and Technologies:
Java, Flink, Kafka, AWS S3, SQL, Mockito, Cucumber, Jenkins, Sonar, Git, Docker, NiFi, Jira.

Java Flink Kafka Scala Spark HDFS Hive
Banking Company
Big Data Engineer
BANKING AND INSURANCE
June 2019 - March 2020 (9 months)
Madrid, Spain
Development of Data Ingestion, Transformation, and Quality Validation Processes
Aligned with the bank's architecture, including data structure modeling. Planned and monitored batch processes, ensuring continuous integration across the various layers.

Tools and Technologies:
Scala, Spark, HDFS, PowerDesigner, Kirby, Hammurabi, Control-M, Git, Jenkins, Docker, Artifactory, Jira.
Scala Spark HDFS Control-M Spark SQL