I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines and analytics platforms across manufacturing, financial services, and technology domains. I have led cross-functional teams to migrate millions of records to modern cloud-based data platforms, improving data accessibility and operational efficiency. I specialize in Python, SQL, Snowflake, dbt, Apache Airflow, and CI/CD, delivering quality data products and dashboards (Power BI, Tableau) that empower Finance, Sales, and Operations teams to make data-driven decisions. I am passionate about data quality, automation, and scalable architectures.

Shubham Heda

I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines and analytics platforms across manufacturing, financial services, and technology domains. I have led cross-functional teams to migrate millions of records to modern cloud-based data platforms, improving data accessibility and operational efficiency. I specialize in Python, SQL, Snowflake, dbt, Apache Airflow, and CI/CD, delivering quality data products and dashboards (Power BI, Tableau) that empower Finance, Sales, and Operations teams to make data-driven decisions. I am passionate about data quality, automation, and scalable architectures.

Available to hire

I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines and analytics platforms across manufacturing, financial services, and technology domains. I have led cross-functional teams to migrate millions of records to modern cloud-based data platforms, improving data accessibility and operational efficiency.

I specialize in Python, SQL, Snowflake, dbt, Apache Airflow, and CI/CD, delivering quality data products and dashboards (Power BI, Tableau) that empower Finance, Sales, and Operations teams to make data-driven decisions. I am passionate about data quality, automation, and scalable architectures.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate

Work Experience

Data Engineer at ICAST (International Center for Appropriate & Sustainable Technology)
August 1, 2021 - February 1, 2025
Led a cross-functional team to migrate 3.5M+ financial records from Sage Intacct to Snowflake and standardized the data workflow, reducing manual work by 23%. Architected Snowflake data models and schemas to enhance query performance and achieve 96% data accuracy. Retrieved financial data (GL, AP, AR, Projects) from Sage Intacct using PySpark on AWS EMR, staged in S3, and loaded into Snowflake via Snowpipe, cutting processing time by 9 minutes. Developed an AWS Glue ETL pipeline orchestrated with Apache Airflow to ingest Smartsheet data into Snowflake (23 sheets processed daily). Implemented Streams & Tasks for incremental loads and used Time Travel to recover prior data versions, reducing batch processing by 6 minutes. Improved Snowflake performance with Materialized Views and warehouse tuning, achieving ~34% faster analytics. Implemented Zero-Copy Cloning for testing and enforced RBAC for data access control. Refactored data using dbt with macros and Jinja, added dbt tests for data v
Data Engineer at Zensar Technologies, India
January 1, 2017 - July 1, 2019
Engineered data pipelines from external sources (web pages and APIs) to internal data warehouses (MS SQL Server, BigQuery), reducing manual integration time by 42%. Leverages Python packages (NumPy, Pandas, Matplotlib, SciPy) for feature engineering and ML model development, boosting model accuracy and reliability. Designed ER diagrams and created a MS SQL database to store 53K IoT device data for real-time analytics. Built Tableau dashboards to enhance stakeholder visibility, driving a 2x sales performance increase within 8 months. Adopted Agile practices (daily stand-ups, bi-weekly sprints), reducing project delivery time by 25% and improving cross-team collaboration by 29%.

Education

Master of Science in Information Systems at University of Maryland, Baltimore
August 1, 2019 - May 1, 2021
Bachelor of Engineering in Information Technology at University of Pune, India
August 1, 2014 - May 1, 2018

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Professional Services, Manufacturing, Education, Financial Services