Led the rewrite of the entire podcast ingestion system using Golang, reducing the number of consumers from 200 to 50 and achieving a 75% cost reduction. Architected and implemented a scalable media asset ingestion pipeline for OSN+ SVOD platform in Golang. Built high-performance gRPC and RESTful APIs with Redis caching for media asset management serving over 100k daily requests. Engineered an efficient MySQL unloader in Scala for optimized data migration to AWS S3 in Parquet format. Led a successful migration from Presto to Trino for AWS data warehouse optimization. Addressed critical latency issues for late podcast releases by introducing a prediction system, significantly reducing user complaints. Developed Spark jobs in Scala to analyze historical data and generate podcast release predictions, ensuring timely content availability. Implemented popularity and tier algorithms using Spark for content recommendations reaching over 30 million users. Developed ML-based artist search syste

Senior Software Engineer at Anghami

July 1, 2022 - Present

Led end-to-end engineering for data platform and infrastructure. Rewrote the podcast ingestion management system in Go, migrated ML-based and SQL-based Spark workflows to run on GPUs with NVIDIA RAPIDS, achieving a 75% cost reduction by reducing consumers from 200 to 50; achieved 5-10% cost reductions on AWS EMR and up to 7-10x performance improvements for migrated workloads. Debugged and improved a MySQL data unloader to Parquet for efficient data migration to S3. Rewrote a DDEX parser in Go as part of a team-wide PHP-to-Go migration. Built high-performance gRPC and RESTful APIs with Redis caching serving ~100k daily requests. Implemented predictive systems to address late podcast releases, developed Spark jobs for historical data analysis and release predictions, and designed popularity/tier algorithms for content recommendations affecting 30M+ users. Implemented event-driven processing with Kafka and AWS SQS, integrated DRM and content protection, and contributed video encoding/tran