Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Principal Data Engineer with 10+ years of experience designing, building, and modernizing enterprise data platforms, data warehouses, and scalable ETL/ELT solutions across cloud and on-prem environments. Expertise spans data architecture, lakehouse and real-time processing, data governance, and cloud migrations. Strong hands-on background with Apache Spark/PySpark, Kafka, NiFi, Airflow, Snowflake, Databricks, and Microsoft Fabric, along with automation in Python and enterprise integration tools. Experienced leading cross-functional teams to deliver governed, high-impact analytics solutions supporting BI, AI/ML, and enterprise reporting.…Principal Data Engineer with 10+ years of experience designing, building, and modernizing enterprise data platforms, data warehouses, and scalable ETL/ELT solutions across cloud and on-prem environments. Expertise spans data architecture, lakehouse and real-time processing, data governance, and cloud migrations. Strong hands-on background with Apache Spark/PySpark, Kafka, NiFi, Airflow, Snowflake, Databricks, and Microsoft Fabric, along with automation in Python and enterprise integration tools. Experienced leading cross-functional teams to deliver governed, high-impact analytics solutions supporting BI, AI/ML, and enterprise reporting.

ZAIN ALI





Principal Data Engineer with 10+ years of experience designing, building, and modernizing enterprise data platforms, data warehouses, and scalable ETL/ELT solutions across cloud and on-prem environments. Expertise spans data architecture, lakehouse and real-time processing, data governance, and cloud migrations. Strong hands-on background with Apache Spark/PySpark, Kafka, NiFi, Airflow, Snowflake, Databricks, and Microsoft Fabric, along with automation in Python and enterprise integration tools. Experienced leading cross-functional teams to deliver governed, high-impact analytics solutions supporting BI, AI/ML, and enterprise reporting.…Principal Data Engineer with 10+ years of experience designing, building, and modernizing enterprise data platforms, data warehouses, and scalable ETL/ELT solutions across cloud and on-prem environments. Expertise spans data architecture, lakehouse and real-time processing, data governance, and cloud migrations. Strong hands-on background with Apache Spark/PySpark, Kafka, NiFi, Airflow, Snowflake, Databricks, and Microsoft Fabric, along with automation in Python and enterprise integration tools. Experienced leading cross-functional teams to deliver governed, high-impact analytics solutions supporting BI, AI/ML, and enterprise reporting.

Available to hire

Principal Data Engineer with 10+ years of experience designing, building, and modernizing enterprise data platforms, data warehouses, and scalable ETL/ELT solutions across cloud and on-prem environments. Expertise spans data architecture, lakehouse and real-time processing, data governance, and cloud migrations.

Strong hands-on background with Apache Spark/PySpark, Kafka, NiFi, Airflow, Snowflake, Databricks, and Microsoft Fabric, along with automation in Python and enterprise integration tools. Experienced leading cross-functional teams to deliver governed, high-impact analytics solutions supporting BI, AI/ML, and enterprise reporting.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Intermediate

Language

English

Fluent

Work Experience

Principal Data Engineer at MicroDev Solutions

January 1, 2023 - Present

Led a team of 5 data engineers designing and maintaining enterprise-scale ETL/ELT pipelines using Databricks and cloud data infrastructure across AWS and Azure. Architected cloud data platforms processing 5+ TB/day across Azure, AWS, GCP, Snowflake, Redshift, and BigQuery. Modernized legacy ETL to Azure Data Factory, Databricks, Snowflake, and Delta Lake. Built scalable ETL/ELT and CDC pipelines using Python, PySpark/Spark, NiFi, Airflow, dbt, and Informatica. Developed real-time streaming using Kafka, Spark Streaming, and Event Hub for low-latency integration. Implemented data governance, data quality, metadata management, and lineage with automated deployments using Terraform, Docker, Kubernetes, and CI/CD; coordinated governance and access frameworks using Unity Catalog and schema registry.

Senior Data Engineer at Surge AI

February 1, 2021 - December 1, 2022

Designed and optimized ETL/ELT pipelines with Spark/PySpark, Airflow, and Kafka processing billions of records. Migrated Teradata and Oracle workloads to Snowflake, AWS S3, and Redshift, reducing costs by 40%. Built cloud-native analytics solutions using AWS Glue, EMR, S3, Redshift, and Snowflake. Created Power BI dashboards for KPIs and stakeholder insights. Implemented CDC, data quality, monitoring, and lineage frameworks for reliable governed delivery, and developed automated data transformation/feature engineering pipelines for analytics and AI/ML.

Data Engineer at Replo

November 1, 2017 - January 1, 2021

Modernized legacy ETL pipelines and data warehouse workflows, improving processing speed by 30%. Implemented Python, Kafka, Elasticsearch, FluentD, and GCP (GKE) solutions supporting 5+ TB/day ingestion. Assisted migration from on-prem Oracle systems to AWS Redshift to improve scalability and reporting performance. Designed and implemented a robust warehouse and ETL consolidation pipeline for another 30% processing speed improvement, and created lightweight data lineage maps to trace source-to-report data flow.

Junior Engineer at eBay

June 1, 2016 - November 1, 2017

Managed ETL pipelines integrating data from 15+ enterprise systems including CRM, ERP, and marketing platforms. Built Python and SQL transformation scripts, improving integration performance by 30%. Assisted in designing warehouse schemas and dimensional data models for reporting and analytics. Optimized SQL queries and database indexing strategies improving reporting performance by 25%.