Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I’m a Databricks Certified Data Engineer with 15+ years of experience building enterprise-grade data platforms across Azure and Databricks, helping teams turn raw data into reliable analytics. I specialize in end-to-end lakehouse ELT using PySpark, dbt, and orchestration with Airflow/Databricks Workflows, with strong focus on governance, security, and performance. In my recent roles, I’ve delivered production pipelines for major Australian organizations (including ANZ and Optus), building Medallion Architecture solutions (Bronze/Silver/Gold) and implementing Delta Lake features such as Liquid Clustering and Unity Catalog. I also enjoy collaborating across business and technical stakeholders, mentoring engineers, and driving CI/CD automation so data products are repeatable, auditable, and ready for real-world reporting.…I’m a Databricks Certified Data Engineer with 15+ years of experience building enterprise-grade data platforms across Azure and Databricks, helping teams turn raw data into reliable analytics. I specialize in end-to-end lakehouse ELT using PySpark, dbt, and orchestration with Airflow/Databricks Workflows, with strong focus on governance, security, and performance. In my recent roles, I’ve delivered production pipelines for major Australian organizations (including ANZ and Optus), building Medallion Architecture solutions (Bronze/Silver/Gold) and implementing Delta Lake features such as Liquid Clustering and Unity Catalog. I also enjoy collaborating across business and technical stakeholders, mentoring engineers, and driving CI/CD automation so data products are repeatable, auditable, and ready for real-world reporting.

Nagarjuna Annareddy





I’m a Databricks Certified Data Engineer with 15+ years of experience building enterprise-grade data platforms across Azure and Databricks, helping teams turn raw data into reliable analytics. I specialize in end-to-end lakehouse ELT using PySpark, dbt, and orchestration with Airflow/Databricks Workflows, with strong focus on governance, security, and performance. In my recent roles, I’ve delivered production pipelines for major Australian organizations (including ANZ and Optus), building Medallion Architecture solutions (Bronze/Silver/Gold) and implementing Delta Lake features such as Liquid Clustering and Unity Catalog. I also enjoy collaborating across business and technical stakeholders, mentoring engineers, and driving CI/CD automation so data products are repeatable, auditable, and ready for real-world reporting.…I’m a Databricks Certified Data Engineer with 15+ years of experience building enterprise-grade data platforms across Azure and Databricks, helping teams turn raw data into reliable analytics. I specialize in end-to-end lakehouse ELT using PySpark, dbt, and orchestration with Airflow/Databricks Workflows, with strong focus on governance, security, and performance. In my recent roles, I’ve delivered production pipelines for major Australian organizations (including ANZ and Optus), building Medallion Architecture solutions (Bronze/Silver/Gold) and implementing Delta Lake features such as Liquid Clustering and Unity Catalog. I also enjoy collaborating across business and technical stakeholders, mentoring engineers, and driving CI/CD automation so data products are repeatable, auditable, and ready for real-world reporting.

Available to hire

I’m a Databricks Certified Data Engineer with 15+ years of experience building enterprise-grade data platforms across Azure and Databricks, helping teams turn raw data into reliable analytics. I specialize in end-to-end lakehouse ELT using PySpark, dbt, and orchestration with Airflow/Databricks Workflows, with strong focus on governance, security, and performance.

In my recent roles, I’ve delivered production pipelines for major Australian organizations (including ANZ and Optus), building Medallion Architecture solutions (Bronze/Silver/Gold) and implementing Delta Lake features such as Liquid Clustering and Unity Catalog. I also enjoy collaborating across business and technical stakeholders, mentoring engineers, and driving CI/CD automation so data products are repeatable, auditable, and ready for real-world reporting.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Intermediate

Language

English

Advanced

Work Experience

Senior Data Engineer at Tech Mahindra (Client: Optus)

January 1, 2026 - Present

Built production-grade end-to-end pipelines for Optus prepaid analytics, ingesting prepaid sales orders and Pega DCM case management data into the Unified Data Platform using ADF, Databricks, and Airflow. Designed Bronze and Silver Delta Lake entities with Liquid Clustering and PII masking (row/column-level security), plus retention policies aligned to PCI-DSS requirements within a Medallion Lakehouse approach. Delivered gift card reconciliation and Comviva response feed ingestion workflows to accelerate customer audit and CVM campaign analytics. Managed Airflow DAGs and CI/CD deployments via Azure DevOps across Dev, pre-production, and production environments to support repeatable releases.

Data Engineer at ANZ Bank (Melbourne, VIC)

November 1, 2023 - December 1, 2025

Designed and delivered end-to-end ELT pipelines on DBT ingesting data from Teradata and cloud storage into a unified Lakehouse to enable Home Loans forensics reporting across multiple business divisions. Built and maintained forensics compliance reports meeting internal audit standards with data lineage tracked via DBT. Optimized partitioning and caching strategies to improve query performance across large-scale Home Loans datasets. Automated workflows using Airflow DAGs and delivered repeatable releases using GitHub Actions CI/CD across multiple environments. Partnered with business stakeholders to translate complex requirements into scalable pipeline architectures and technical specifications.

Data Engineer at ANZ Bank

November 1, 2023 - December 31, 2025

Designed and delivered ELT pipelines using dbt that ingested data from Teradata and cloud storage into a unified Lakehouse for Home Loans forensics reporting across multiple business divisions. Built and maintained compliance-focused forensic reports with data lineage tracked end-to-end through dbt. Optimized partitioning and caching strategies to improve query performance across large home loans datasets. Automated operational workflows using Airflow DAGs for timely report execution, and implemented CI/CD via GitHub Actions to enable efficient deployments across multiple environments. Partnered with business stakeholders to translate complex requirements into scalable pipeline architectures.

Data Engineer at Tata Consultancy Services (Client: ANZ Bank)

January 1, 2019 - November 1, 2023

Performed data sourcing and profiling, established data quality rules, and developed DQ/DI reporting to support reliable decision-making across multiple ANZ divisions. Designed and developed risk and customer transparency dashboards (AU Customer, Pacific KYC, BCBS Operational Risk, and BCBS Retail/Wholesale Risk) using QlikView. Built automated data integrity checks in Python to reduce manual reconciliation effort. Delivered FATCA/CRS regulatory reports, including high/low-level design and complex attribute-mapping rules for integration through FATCA Stage A and B, and created SQL loader scripts for flat-file to Oracle ingestion. Led PCI-DSS impact assessment and remediation across 40+ PAN data tables, implementing sensitive data masking and managing SIT/production migration and support.

Data Engineer at Tata Consultancy Services (Client: ANZ Bank) — Bangalore, India

February 1, 2016 - January 1, 2019

Delivered ETL enhancements and an UAM compliant project by restructuring EDW RSDS tables and implementing user role setup based on source system, subsystem, geography, and data classification. Conducted impact assessments across ETL flows and designed transformation changes, supporting SIT/production migrations and post-deployment warranty. Maintained version control with GitHub, performed unit testing and debugging, and documented results against business requirements.

Data Engineer at Tata Consultancy Services (Client: ANZ Bank)

February 1, 2016 - January 1, 2019

Delivered ETL pipeline enhancements and supported an UAM-compliant initiative by restructuring EDW RSDS tables and implementing user role setup based on source system, subsystem, geography, and data classification. Conducted impact assessments and designed transformation changes, supporting SIT and production migration with post-deployment warranty support. Maintained version control with GitHub, performed unit testing and debugging, and documented outcomes against business requirements.

Technical Analyst at Thirdware Solution Ltd / Tech Mahindra — Chennai, India

August 1, 2010 - February 1, 2016

Delivered ETL pipelines using Oracle PL/SQL, Teradata, and Control-M for enterprise data warehousing programs. Performed data profiling, root cause analysis, and data quality remediation for large datasets. Supported end-to-end migration and SIT/UAT testing activities across Dev, SIT, and production environments.

Technical Analyst at Thirdware Solution Ltd / Tech Mahindra

August 1, 2010 - February 1, 2016

Delivered enterprise ETL pipelines using Oracle PL/SQL, Teradata, and Control-M for data warehousing projects. Conducted data profiling, root cause analysis, and data quality remediation for large datasets. Supported end-to-end migration and SIT/UAT testing activities across Dev, SIT, and production environments.