Usman Murad

• ● Designed and maintained end-to-end data ingestion pipelines for 200+ datasets using Python, SQL, Airflow, Snowflake and AWS services, handling over 5 TB of transactional data daily.

• ● Led several pipeline upgrade projects, moving a legacy Python/PostgreSQL system to a modern Snowflake ELT model. This made data ready faster and reduced processing time by 80%.

• ● Engineered and maintained data feeds for core AI/ML prediction models, enabling new commercial revenue streams.

• ● Optimized critical pipeline runtime by 50% (12 hrs to 6 hrs) via complex SQL optimization on Snowflake.

• ● Improved data quality and consistency by 90% by adding automatic checks and fixing pipelines with logging.

• ● Built a low-latency FastAPI microservice that served as the data access layer for multiple internal microservices and systems.

• ● Led a team of junior engineers and coached on data governance and code standards.

• ● Worked with partnership teams in the US/Europe, data sellers, and other teams (QA/Full-Stack) to agree on requirements and stop major data problems before they happened.

• ● Maintained a scalable data warehouse using dbt for edX platform, including defining models, tests, and documentation.

• ● Built transformation models using Advanced SQL to enable data-driven course recommendations and user traffic optimization.