Available to hire
Hi, I’m Uzair Amer, a Senior Data Engineer with 6+ years of experience building scalable, resilient data systems in cloud environments (AWS). I specialize in architecting real-time and batch data pipelines, optimizing ETL/ELT performance, and enabling ML/AI workflows at scale.
I have a proven track record of improving system performance, reducing cloud costs, and delivering actionable insights for business-critical decisions. I enjoy mentoring junior engineers and leading cross-functional teams to deliver value through clean data governance and robust architectures.
Skills
See more
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Language
English
Fluent
Urdu
Advanced
Work Experience
Senior Data Engineer / Team Lead at Arbisoft
July 1, 2021 - November 3, 2025Optimized ETL jobs by resolving compute and I/O bottlenecks; rewrote core logic with asynchronous and multithreading; reduced runtimes by over 50%. Built scalable data pipelines for terabyte-scale workloads using partitioned indexing; redesigned Airflow infrastructure for horizontal scaling and modular workflows; eliminated resource contention and reduced monthly infrastructure costs by ~$3,000. Led pipelines across Airflow executors (Local, Celery, Kubernetes), with XComs and TaskFlow API; improved PostgreSQL latency from 540 ms to 80 ms through indexed partitioning and optimized sort order; defined star-schema models to support product analytics and ML teams; enforced data governance with naming standards and access policies; integrated external financial data feeds to enable margin forecasting and analytics.
Data Engineer (Web + Infra) at Arbisoft
July 1, 2021 - July 1, 2021Engineered and maintained 7,000+ production-grade web crawlers in Python to ingest retail product data across global apparel sites; managed distributed deployments across AWS regions and VM instances. Built internal anti-detection tools, including a proxy pool manager, request-tracking and bot-detection logic, and a user-agent rotation library to mimic human behavior at scale. Optimized crawler runtime with generators, decorators, context managers, multithreading, and multiprocessing for parallelism and fault tolerance. Created a client-facing CFO dashboard aggregating sales data from vendor APIs and internal sources; centralized logging using Elasticsearch and Logstash across thousands of nodes.
Education
BS (Hons.) Computer Science at University of Punjab, Lahore, Pakistan
January 11, 2030 - June 1, 2019Qualifications
Udacity - Data Engineering Nanodegree
January 11, 2030 - November 3, 2025Docker & Kubernetes: The Practical Guide
January 11, 2030 - November 3, 2025Apache Airflow on AWS EKS: The Hands-On Guide
January 11, 2030 - November 3, 2025Modernizing Data Lakes and Data Warehouses with GCP
January 11, 2030 - November 3, 2025Google Cloud Platform Big Data and Machine Learning Fundamentals
January 11, 2030 - November 3, 2025Industry Experience
Software & Internet, Professional Services
Skills
See more
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Hire a Back-End Developer
We have the best back-end developer experts on Twine. Hire a back-end developer in Lahore today.