Hi, I'm Uzair Amer, a Senior Data Engineer with 6+ years of experience building scalable, resilient data systems in cloud environments (AWS). I specialize in architecting real-time and batch data pipelines, optimizing ETL/ELT performance, and enabling ML/AI workflows at scale. I have a proven track record of improving system performance, reducing cloud costs, and delivering actionable insights for business-critical decisions. I enjoy mentoring junior engineers and leading cross-functional teams to deliver value through clean data governance and robust architectures.

Uzair Amer

Hi, I'm Uzair Amer, a Senior Data Engineer with 6+ years of experience building scalable, resilient data systems in cloud environments (AWS). I specialize in architecting real-time and batch data pipelines, optimizing ETL/ELT performance, and enabling ML/AI workflows at scale. I have a proven track record of improving system performance, reducing cloud costs, and delivering actionable insights for business-critical decisions. I enjoy mentoring junior engineers and leading cross-functional teams to deliver value through clean data governance and robust architectures.

Available to hire

Hi, I’m Uzair Amer, a Senior Data Engineer with 6+ years of experience building scalable, resilient data systems in cloud environments (AWS). I specialize in architecting real-time and batch data pipelines, optimizing ETL/ELT performance, and enabling ML/AI workflows at scale.

I have a proven track record of improving system performance, reducing cloud costs, and delivering actionable insights for business-critical decisions. I enjoy mentoring junior engineers and leading cross-functional teams to deliver value through clean data governance and robust architectures.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
See more

Language

English
Fluent
Urdu
Advanced

Work Experience

Senior Data Engineer / Team Lead at Arbisoft
July 1, 2021 - November 3, 2025
Optimized ETL jobs by resolving compute and I/O bottlenecks; rewrote core logic with asynchronous and multithreading; reduced runtimes by over 50%. Built scalable data pipelines for terabyte-scale workloads using partitioned indexing; redesigned Airflow infrastructure for horizontal scaling and modular workflows; eliminated resource contention and reduced monthly infrastructure costs by ~$3,000. Led pipelines across Airflow executors (Local, Celery, Kubernetes), with XComs and TaskFlow API; improved PostgreSQL latency from 540 ms to 80 ms through indexed partitioning and optimized sort order; defined star-schema models to support product analytics and ML teams; enforced data governance with naming standards and access policies; integrated external financial data feeds to enable margin forecasting and analytics.
Data Engineer (Web + Infra) at Arbisoft
July 1, 2021 - July 1, 2021
Engineered and maintained 7,000+ production-grade web crawlers in Python to ingest retail product data across global apparel sites; managed distributed deployments across AWS regions and VM instances. Built internal anti-detection tools, including a proxy pool manager, request-tracking and bot-detection logic, and a user-agent rotation library to mimic human behavior at scale. Optimized crawler runtime with generators, decorators, context managers, multithreading, and multiprocessing for parallelism and fault tolerance. Created a client-facing CFO dashboard aggregating sales data from vendor APIs and internal sources; centralized logging using Elasticsearch and Logstash across thousands of nodes.

Education

BS (Hons.) Computer Science at University of Punjab, Lahore, Pakistan
January 11, 2030 - June 1, 2019

Qualifications

Udacity - Data Engineering Nanodegree
January 11, 2030 - November 3, 2025
Docker & Kubernetes: The Practical Guide
January 11, 2030 - November 3, 2025
Apache Airflow on AWS EKS: The Hands-On Guide
January 11, 2030 - November 3, 2025
Modernizing Data Lakes and Data Warehouses with GCP
January 11, 2030 - November 3, 2025
Google Cloud Platform Big Data and Machine Learning Fundamentals
January 11, 2030 - November 3, 2025

Industry Experience

Software & Internet, Professional Services

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
See more

Hire a Back-End Developer

We have the best back-end developer experts on Twine. Hire a back-end developer in Lahore today.