Senior Data Engineer with 8+ years of experience building and optimizing scalable data pipelines, data warehouses, and cloud data platforms across banking, insurance, telecommunications, healthcare, and retail. Skilled in Python, SQL, PySpark, Apache Spark, Airflow, dbt, Databricks, Snowflake, AWS, and Azure, with strong experience in ETL/ELT workflows, batch and streaming pipelines, and automated data quality processes. Experienced in cloud data migration, performance optimization, CI/CD, data governance, and production troubleshooting. Strong background in near-real-time ingestion (Kafka/Spark Structured Streaming), building reusable semantic models for analytics, and implementing monitoring and lineage practices for regulated environments.

Pennada Venkata Mounish

Senior Data Engineer with 8+ years of experience building and optimizing scalable data pipelines, data warehouses, and cloud data platforms across banking, insurance, telecommunications, healthcare, and retail. Skilled in Python, SQL, PySpark, Apache Spark, Airflow, dbt, Databricks, Snowflake, AWS, and Azure, with strong experience in ETL/ELT workflows, batch and streaming pipelines, and automated data quality processes. Experienced in cloud data migration, performance optimization, CI/CD, data governance, and production troubleshooting. Strong background in near-real-time ingestion (Kafka/Spark Structured Streaming), building reusable semantic models for analytics, and implementing monitoring and lineage practices for regulated environments.

Available to hire

Senior Data Engineer with 8+ years of experience building and optimizing scalable data pipelines, data warehouses, and cloud data platforms across banking, insurance, telecommunications, healthcare, and retail. Skilled in Python, SQL, PySpark, Apache Spark, Airflow, dbt, Databricks, Snowflake, AWS, and Azure, with strong experience in ETL/ELT workflows, batch and streaming pipelines, and automated data quality processes.

Experienced in cloud data migration, performance optimization, CI/CD, data governance, and production troubleshooting. Strong background in near-real-time ingestion (Kafka/Spark Structured Streaming), building reusable semantic models for analytics, and implementing monitoring and lineage practices for regulated environments.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
Intermediate
Intermediate
Intermediate
Beginner
Beginner
See more

Work Experience

Senior Data Engineer at EQ Bank
January 1, 2025 - Present
Designed and built scalable ELT pipelines using Apache Airflow and dbt to ingest data from core banking systems into Snowflake, processing several million records daily. Developed Python-based transformations to cleanse and standardize deposit and lending data from multiple upstream systems. Built near-real-time ingestion with Kafka and Spark Structured Streaming for fraud-detection model feeds. Optimized Snowflake warehouse performance via query tuning, clustering keys, and materialized views (35% reduction in average report query runtime). Implemented CI/CD with GitLab CI and Terraform to automate pipeline infrastructure deployment on AWS. Automated data quality checks using Great Expectations (40% reduction in downstream validation errors) and created reusable dbt semantic models consumed by Tableau dashboards. Participated in on-call rotation, troubleshooting pipeline failures and resolving data latency incidents within SLA; reviewed PRs and improved naming conventions, test covera
Senior Data Engineer at Manulife
December 1, 2022 - January 1, 2025
Built and maintained ETL pipelines using Azure Data Factory and Databricks to process claims and policy data extracted from legacy mainframe systems, migrating on-prem SQL Server data warehouses to Azure Synapse Analytics and improving average query performance by 45%. Developed PySpark jobs to transform large actuarial datasets for monthly reserve calculations. Implemented a data lake architecture on Azure Data Lake Storage Gen2 using bronze/silver/gold medallion layering. Built Power BI datasets and semantic models for actuarial and finance month-end close reporting. Wrote unit and integration tests for pipeline logic using pytest, improving pipeline reliability. Worked with data governance to implement column-level data lineage tracking using Azure Purview. Automated ingestion of third-party reinsurance feeds via REST APIs and scheduled Azure Functions. Documented pipeline architecture and data dictionaries for audit and compliance; supported UAT cycles by validating transformed dat
Data Engineer at TELUS
March 1, 2021 - November 1, 2022
Built batch ETL pipelines using Python and Apache Airflow to process customer usage and billing data from telecom OSS/BSS systems. Designed and maintained data models in Google BigQuery to support customer churn prediction analytics. Developed ingestion pipelines from Kafka topics carrying network performance telemetry data, and built/scheduled dbt models to transform raw network data into analytics-ready tables. Optimized BigQuery SQL queries and table partitioning strategies, reducing monthly compute cost by 20%. Collaborated with data science to prepare feature-engineered datasets for churn models. Built pipeline monitoring dashboards in Looker Studio to track job health and data freshness. Migrated legacy on-prem Informatica ETL jobs to cloud-native pipelines on GCP (Cloud Storage and Dataflow). Performed root-cause analysis of recurring source/target data discrepancies, wrote pipeline unit tests, and scheduled data freshness alerts. Built a self-serve BigQuery dataset for marketin
Data Engineer at Unity Health Toronto
October 1, 2019 - February 1, 2021
Built ETL pipelines using SSIS and Python to extract data from Epic EHR into a centralized data warehouse. Developed SQL Server stored procedures and views supporting bed-capacity and clinical operations reporting. Implemented automated validations to verify HL7 message integrity across incoming hospital data feeds. Designed star-schema SQL Server models to support Tableau dashboards used by hospital administration. Automated daily and weekly reporting jobs using SQL Server Agent and Python scripts. Partnered with clinical informatics to map and validate patient, encounter, admission, and discharge fields for operational reporting and analytics; performed data cleansing and deduplication of patient records across multiple hospital sites. Built incremental load processes to reduce ETL runtime for large patient-encounter tables by 30%, supported a data migration project moving legacy Access databases into the enterprise data warehouse, coordinated overnight batch loads to minimize impact
Junior Data Engineer at Shoppers Drug Mart
October 1, 2018 - September 1, 2019
Supported the retail analytics team by assisting with ETL processes using SQL and Python to load daily sales and inventory data into the retail data warehouse. Developed SQL queries and stored procedures to support store performance, sales, and inventory reporting; created Power BI and Excel reports for weekly sales and inventory trends. Tested and validated ETL outputs against POS records to identify data discrepancies and ensure data accuracy. Troubleshot recurring pipeline failures, conducted root-cause analysis, and supported senior engineers with resolutions. Cleaned and standardized product, vendor, and inventory master data across multiple retail source systems; validated field mappings and integrated POS data feeds into existing inventory tables. Documented ETL workflows, data mappings, and data dictionaries; developed a Python automation script to streamline weekly sales-summary reporting and reduce manual effort.

Education

at Bachelor of Technology in Civil Engineering
January 11, 2030 - August 27, 2026

Qualifications

Bachelor of Technology (Civil Engineering)
January 11, 2030 - August 27, 2026
Bachelor of Technology in Civil Engineering
January 11, 2030 - August 27, 2026
Bachelor of Technology in Civil Engineering
January 11, 2030 - August 27, 2026

Industry Experience

Financial Services, Telecommunications, Healthcare, Retail, Other