About Francisco
- ETL/ELT pipelines in Databricks (PySpark, Delta Lake, Unity Catalog)
- Migrating and modernizing data architectures on Azure (ADLS, Data Factory) or AWS (S3, Glue, EMR, Lambda)
- Auditing and optimizing Databricks/Spark costs
- Data quality and governance frameworks
- Productionizing Machine Learning models alongside Data Science teams
- Automating data workflows with CI/CD (Azure DevOps, Jenkins, Docker)
Spanish
Native or bilingual
English
Native or bilingual
Experience
- Mercedes-BenzTech Lead & Data EngineerAUTOMOBILEMay 2021 - Today (5 years and 2 months)Madrid, Spain
- Led and coordinated a multidisciplinary team of 15 professionals, including Data Scientists, Data Engineers, and Data Analysts, mentoring new joiners and defining development guidelines and best practices.
- Translated business requirements into scalable and efficient technical solutions.
- Built an analytics platform for lead generation using PySpark, Databricks and Azure.
- Developed a data quality framework to detect and prevent invalid data before lead delivery.
- Reduced Databricks cluster costs by up to 40% through performance optimization and resource management improvements.
- Defined the data strategy for the Aftersales and R&D areas.
- BBVAData EngineerBANKING AND INSURANCEMarch 2020 - May 2021 (1 year and 2 months)Madrid, Spain
- Developed an end to end data framework in PySpark for customer recommendations, including source data processing, transformations and recommendation output generation following the best practices.
- Collaborated with data scientists to operationalize ML models into production, while optimizing code to ensure high performance, scalability, and maintainability.
- Designed and implemented tests for framework components to ensure reliability and quality, contributing to CI/CD and automated deployment workflows.
- TelefónicaData EngineerTELECOMMUNICATIONSJanuary 2017 - March 2020 (3 years and 2 months)Madrid, Spain
- Normalized terabytes of data from multiple countries using PySpark on a Cloudera cluster.
- Designed and implemented end to end data pipelines, including data ingestion and transformations using AWS Glue and AWS EMR.
- Defined the data model to support scalable and efficient data access.
- Built and maintained APIs to expose data services and implemented API testing using API Gateway
- Orchestrated and automated data workflows and processes using Jenkins.
Recommendations
Be the first to recommend Francisco
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- B.Sc. in Computer ScienceUniversidad Pontificia de Salamanca2016B.Sc. in Computer Science
- B.Sc. in Computer ScienceGlyndwr University2015B.Sc. in Computer Science