Freelancer profile translated to English.

Description

I am a data engineer with a focus on Cloud and DevOps. I have operated with scalable batch pipelines using Python and Spark (PySpark), orchestrated with Airflow and automated with GitLab CI/CD on AWS (S3). I have worked on streaming and real-time analysis with Kafka and Flink, and built ETLs with NiFi. I integrate monitoring and observability with Prometheus/Telegraf/InfluxDB, Grafana, and ELK (Elasticsearch/Kibana), and also develop solutions in Azure and Power BI when the project requires it.

Industry field of expertise

Languages

Spanish
Native or bilingual
English
Fluent

Workplace preferences

Remote only

Primarily works remotely

OLX
Data Engineer
October 2024 - Today (1 year and 8 months)
Developed and maintained scalable Airflow DAGs for internal framework.
Refactored legacy data pipelines using PySpark, improving efficiency, scalability, and code quality.
Built GitLab CI/CD pipelines to automate DAG generation, deployment workflows, and S3 data operations.
Designed and optimized distributed data processing workflows with PySpark for large-scale experimentation data.
Produced clear, maintainable technical documentation to support knowledge sharing and team scaling.
Delivered production-grade data engineering solutions in collaboration with cross-functional teams.
Airflow AWS AWS S3 SQL Python Spark Gitlab PySpark
AVANADE
ML Engineer
January 2024 - October 2024 (9 months)
Madrid, Spain
• Utilized Microsoft Azure services to design, implement, and optimized AI solutions.
• Developed and customized intelligent assistants and chatbots using Copilot Studio.
• Enhanced user interfaces and integrating advanced functionalities with Power Automate.
• Implemented and optimized cloud solutions by leveraging Microsoft Azure services.
Python Microsoft Azure Copilot Power Automate Microsoft Power BI Machine Learning Git
Telefonica
Data/DevOps Engineer
June 2022 - January 2024 (1 year and 7 months)
Madrid, Spain
• Worked on a pipeline that monitors 1 million logs daily for real-time log streaming analysis and processing.
• Developed automation-driven configurations and services with Ansible and Puppet, optimized the installation and configuration of services across numerous servers.
• Ensured seamless development, scaling, and troubleshooting of container technologies by using Kubernetes.
• Streamlined Telefonica-based components development by establishing tracking processes and executing logs through Kafka, Apache Flink, Java, Elasticsearch, and Kibana.
• Ensured seamless integration, processing, storage, and presentation of KPIs by utilising Prometheus, Telegraf, InfluxDB, and Grafana.
• Implement effective unit testing procedures in the pre-production phase to enhance quality and functionality.
• Administered architecture of hybrid environments and used Microsoft Azure to drive optimal performance.
Elasticsearch Kibana Grafana Apache Kafka Apache Nifi Bash Kubernetes Zabbix Git Ansible Puppet