Syed Waqas Ur Rehman
I’m a Data Engineer from Pakistan with hands-on experience building end-to-end data solutions using Azure, Databricks, PySpark, and SQL.
About
I’m a Data Engineer from Pakistan with hands-on experience building end-to-end data solutions using Azure, Databricks, PySpark, and SQL. I design scalable ETL pipelines, integrate APIs, and transform raw data into datasets that teams can trust for operational reporting and analytics.
In my recent roles, I’ve worked on monitoring and fixing batch and near real-time ETL processes (including Informatica-based workflows) and optimizing data performance through better SQL, data quality checks, and efficient storage in data lakes and SQL systems. I’m especially focused on reliable pipelines, strong data modeling, and automation that reduces manual effort while maintaining high data accuracy.
- 1 year's experience
- Joined September 2026
Industry experience
- Software & Internet
- Financial Services
- Professional Services
More experts in Islamabad, Pakistan
Work experience
Monitored and fixed batch and near real-time ETL pipelines using Informatica to ingest and process 1TB+ of raw data from Oracle, IBM DB2, and MongoDB. Transformed and stored data in a data lake (HDFS) and SQL Server using Parquet and SQL for optimized analytics. Built stored procedures, functions, and triggers to improve consistency and performance. Supported operational reporting and business analytics with optimized datasets and automated workflows, and performed daily data quality checks and reconciliation.
Designed and deployed 8+ Boomi-based API integrations to synchronize data across 5+ enterprise applications with high operational uptime. Optimized complex SQL queries (joins, subqueries, CTEs) to reduce execution time by about 35%. Automated workflows processing 20K+ records per day, reducing manual intervention by about 60%. Implemented data validation and error-handling to ensure accuracy and consistency, collaborating with cross-functional teams for real-time reporting and insights.
Monitored and fixed batch and near real-time ETL pipelines using Informatica to ingest and process more than 1TB of data from Oracle, IBM DB2, and MongoDB. Transformed and stored data in HDFS and SQL Server using Parquet and SQL to support optimized analytics. Built stored procedures, functions, and triggers for data consistency and performance. Supported operational reporting and business analytics using optimized datasets and automated workflows, and performed daily data quality checks and reconciliation.
Education
Certifications and awards
Hire Syed Waqas Ur Rehman today
Post a job and invite Syed, or contact them directly. No hidden commission.