Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am Priya Kadaluri, a Sr. Data Engineer with over 10 years of experience building scalable data platforms across Banking, Finance, Insurance, Retail, and Telecom. I specialize in Azure-based data architectures, Databricks, Snowflake, and end-to-end ETL/ELT pipelines using Python, PySpark, Scala, and SQL. I design and implement robust data infrastructure, real-time streaming solutions, and ML-enabled analytics to empower data-driven decisions. I have a proven track record delivering end-to-end data solutions with CI/CD automation, cross-functional collaboration, and a focus on performance optimization and maintainability. I thrive in Agile environments and enjoy solving complex data challenges with scalable, cloud-first approaches.…I am Priya Kadaluri, a Sr. Data Engineer with over 10 years of experience building scalable data platforms across Banking, Finance, Insurance, Retail, and Telecom. I specialize in Azure-based data architectures, Databricks, Snowflake, and end-to-end ETL/ELT pipelines using Python, PySpark, Scala, and SQL. I design and implement robust data infrastructure, real-time streaming solutions, and ML-enabled analytics to empower data-driven decisions. I have a proven track record delivering end-to-end data solutions with CI/CD automation, cross-functional collaboration, and a focus on performance optimization and maintainability. I thrive in Agile environments and enjoy solving complex data challenges with scalable, cloud-first approaches.

Priya Kadaluri

Data Scientist, Data Analyst, Full Stack Developer, +2





I am Priya Kadaluri, a Sr. Data Engineer with over 10 years of experience building scalable data platforms across Banking, Finance, Insurance, Retail, and Telecom. I specialize in Azure-based data architectures, Databricks, Snowflake, and end-to-end ETL/ELT pipelines using Python, PySpark, Scala, and SQL. I design and implement robust data infrastructure, real-time streaming solutions, and ML-enabled analytics to empower data-driven decisions. I have a proven track record delivering end-to-end data solutions with CI/CD automation, cross-functional collaboration, and a focus on performance optimization and maintainability. I thrive in Agile environments and enjoy solving complex data challenges with scalable, cloud-first approaches.…I am Priya Kadaluri, a Sr. Data Engineer with over 10 years of experience building scalable data platforms across Banking, Finance, Insurance, Retail, and Telecom. I specialize in Azure-based data architectures, Databricks, Snowflake, and end-to-end ETL/ELT pipelines using Python, PySpark, Scala, and SQL. I design and implement robust data infrastructure, real-time streaming solutions, and ML-enabled analytics to empower data-driven decisions. I have a proven track record delivering end-to-end data solutions with CI/CD automation, cross-functional collaboration, and a focus on performance optimization and maintainability. I thrive in Agile environments and enjoy solving complex data challenges with scalable, cloud-first approaches.

Available to hire

I am Priya Kadaluri, a Sr. Data Engineer with over 10 years of experience building scalable data platforms across Banking, Finance, Insurance, Retail, and Telecom. I specialize in Azure-based data architectures, Databricks, Snowflake, and end-to-end ETL/ELT pipelines using Python, PySpark, Scala, and SQL. I design and implement robust data infrastructure, real-time streaming solutions, and ML-enabled analytics to empower data-driven decisions.

I have a proven track record delivering end-to-end data solutions with CI/CD automation, cross-functional collaboration, and a focus on performance optimization and maintainability. I thrive in Agile environments and enjoy solving complex data challenges with scalable, cloud-first approaches.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Work Experience

Sr. Data Engineer at Apple

October 1, 2024 - November 6, 2025

Designed and implemented end-to-end data infrastructure on Azure, leveraging Blob Storage, Synapse, Databricks, Data Factory, Functions, and Virtual Machines, integrated with Snowflake and DBT for scalable ETL pipelines. Built real-time Spark Streaming and Kafka pipelines, and MLlib workflows for predictive analytics and operational reporting. Developed PySpark and Python DataFrames for complex transformations, and led CI/CD pipelines using Jenkins and Azure DevOps for Databricks, Snowflake, and DBT deployments. Implemented automated monitoring scripts for Azure Blob Storage, Databricks jobs, and Kafka streams to ensure reliability.

Sr. Data Engineer at Best Buy

August 1, 2024 - August 1, 2024

Implemented installation and configuration of multi-node clusters on Azure using Virtual Machines, Databricks, and HDInsight. Monitored environments with Azure Monitor and managed log data in Azure Blob Storage. Integrated Azure Cosmos DB with Azure Functions to back up Change Feed events and enable real-time processing with Kafka and Databricks. Designed data warehouses on Azure Synapse, Databricks, and Snowflake, and automated ETL/ELT pipelines with PySpark, SQL, and DBT.

Sr. Data Engineer at Encompass Health

October 1, 2022 - October 1, 2022

Designed and delivered end-to-end data infrastructure on Azure, including Synapse, Databricks, Snowflake, and Airflow-based orchestration. Built scalable data warehouses, implemented data validation, transforms, and aggregations, and developed streaming and batch pipelines with Kafka. Enabled MLOps pipelines for deploying models and created UDFs and RAG-based systems for automated text summarization using Databricks. Optimized performance through partitioning, bucketing, and hardware-aware tuning, and managed Kubernetes clusters on AKS.

Data Engineer at Ross Stores

June 1, 2020 - June 1, 2020

Processed web logs and built multi-source ETL pipelines using Azure Data Factory and Databricks. Ingested data from APIs, Azure Blob Storage, Teradata, Synapse, and Databricks; implemented data ingestion pipelines with Spark SQL and Python. Created partitioned tables and optimized query performance with Hive/Spark, and enabled real-time analytics using Kafka integration. Implemented CI/CD pipelines via Jenkins for automated deployment of Databricks, Snowflake, and DBT workloads.

Data Engineer at Zerodha

July 1, 2016 - July 1, 2016

Migrated financial datasets to Azure, leveraging Spark, PySpark, and Databricks for large-scale processing. Built real-time and batch ETL pipelines, moved data between Azure Blob Storage, Synapse, Snowflake, and Databricks, and implemented data modeling (Star/Snowflake). Created dashboards with Power BI and Tableau for validation and business insights, and integrated Spark/Databricks with Python/Scala for scalable ETL workflows.

Data Engineer at BMO USA

September 1, 2018 - September 1, 2018

Gained experience migrating financial data to Azure, building ETL pipelines with Spark, Databricks, and Azure Data Factory. Ingested data from Oracle, Synapse, and Snowflake; developed dashboards with Power BI and Tableau; implemented CI/CD pipelines with Jenkins for cloud-based data workflows. Collaborated on multi-source data integration and optimization for retail/financial analytics.