Antonino Cilione

Primary Responsibility: Engineered and maintained high-throughput data pipelines specifically for the ingestion of medium and low voltage measurements, ensuring data accuracy and real-time availability for grid analysis. Framework Migration: Led the complex framework migration from Cloudera Distribution Hadoop (CDH) to Cloudera Data Platform (CDP), modernizing the data infrastructure. ETL Development: Developed and maintained high-performance ETL pipelines using Apache Spark and Kafka. R&D & Optimization: Researched and benchmarked Apache Iceberg functionalities using Spark and Flink; successfully implemented a custom "equality delete files" commit feature on Apache Spark. Data Ingestion: Designed and implemented robust data ingestion flows using Apache NiFi. Database Management: Optimized MongoDB Atlas clusters by tuning indexes, memory, and configuring auto-scaling to balance cost and performance. Microservices: Developed Java/Kotlin microservices (Spring Boot) to expose NoSQL data stored on MongoDB to downstream applications. Automation: Authored Python scripts for advanced S3 Parquet file operations (merge, deduplicate, backup, restore) and Bash scripts for automated Kafka/S3 status checks. Performance Tuning: Integrated Redis cache (Redisson) within Spark jobs to reduce latency. Codebase Evolution: Developed complex SQL procedures for data analysis and executed significant codebase refactoring. Tech Stack: Kubernetes, Docker, Git, Dremio.

Developed and maintained a corporate Android banking application. Migrated the codebase from Java to Kotlin. Implemented new user-facing features and performed critical bug fixing to ensure app stability.