Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am a Senior Data Engineer with a passion for building scalable data architectures and robust ETL pipelines that empower data-driven decisions. I enjoy collaborating with cross-functional teams to translate complex data requirements into reliable, scalable solutions. My expertise includes designing and automating ETL flows using Azure Data Factory and Azure Databricks, implementing data solutions on ADLS Gen2, Delta Lake, and Snowflake for advanced analytics, and delivering reporting solutions with Power BI. I am committed to delivering near real-time data processing improvements and ensuring data quality and integrity across the data lifecycle.…I am a Senior Data Engineer with a passion for building scalable data architectures and robust ETL pipelines that empower data-driven decisions. I enjoy collaborating with cross-functional teams to translate complex data requirements into reliable, scalable solutions. My expertise includes designing and automating ETL flows using Azure Data Factory and Azure Databricks, implementing data solutions on ADLS Gen2, Delta Lake, and Snowflake for advanced analytics, and delivering reporting solutions with Power BI. I am committed to delivering near real-time data processing improvements and ensuring data quality and integrity across the data lifecycle.

Prashanthi Reddy





I am a Senior Data Engineer with a passion for building scalable data architectures and robust ETL pipelines that empower data-driven decisions. I enjoy collaborating with cross-functional teams to translate complex data requirements into reliable, scalable solutions. My expertise includes designing and automating ETL flows using Azure Data Factory and Azure Databricks, implementing data solutions on ADLS Gen2, Delta Lake, and Snowflake for advanced analytics, and delivering reporting solutions with Power BI. I am committed to delivering near real-time data processing improvements and ensuring data quality and integrity across the data lifecycle.…I am a Senior Data Engineer with a passion for building scalable data architectures and robust ETL pipelines that empower data-driven decisions. I enjoy collaborating with cross-functional teams to translate complex data requirements into reliable, scalable solutions. My expertise includes designing and automating ETL flows using Azure Data Factory and Azure Databricks, implementing data solutions on ADLS Gen2, Delta Lake, and Snowflake for advanced analytics, and delivering reporting solutions with Power BI. I am committed to delivering near real-time data processing improvements and ensuring data quality and integrity across the data lifecycle.

Available to hire

I am a Senior Data Engineer with a passion for building scalable data architectures and robust ETL pipelines that empower data-driven decisions. I enjoy collaborating with cross-functional teams to translate complex data requirements into reliable, scalable solutions.

My expertise includes designing and automating ETL flows using Azure Data Factory and Azure Databricks, implementing data solutions on ADLS Gen2, Delta Lake, and Snowflake for advanced analytics, and delivering reporting solutions with Power BI. I am committed to delivering near real-time data processing improvements and ensuring data quality and integrity across the data lifecycle.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Sr Data Engineer at TriWest Healthcare Alliance (Avanade)

August 1, 2023 - November 21, 2025

Expanded and optimized data and pipeline architectures; designed ETL pipelines with Azure Data Factory and Azure Databricks across bronze, silver, and gold layers; implemented data solutions with ADLS Gen2, Delta tables, and Snowflake for analytics; automated ingestion with parameterized pipelines; optimized Spark jobs; implemented streaming pipelines for near real-time data; developed reusable utilities for SCD processing; partnered with stakeholders to deliver Power BI reporting; used Delta Lake MERGE for incremental loads.

Sr Data Engineer at Microsoft (Avanade)

July 1, 2023 - July 1, 2023

Designed and developed ETL pipelines with Azure Data Factory to orchestrate ingestion; utilized Azure Data Explorer for log/telemetry analysis; built curated datasets in Power BI; implemented incremental refresh and partition strategies in Synapse; automated data quality validations in pipelines; integrated Azure Data Lake and Delta with Synapse for hybrid analytics; developed reusable utilities and parameterized pipelines; leveraged Azure DevOps CI/CD for deployment.

Sr Data Engineer at JPMorgan Chase

June 1, 2022 - June 1, 2022

Designed and maintained large-scale ETL pipelines using Ab Initio; migrated legacy workloads to AWS Glue and S3; automated batch and near real-time data ingestion; built and optimized ETL jobs; leveraged Hive and HDFS for big data processing; implemented data quality checks and reconciliation for regulatory reporting; partnered with reporting teams to prepare curated datasets for Power BI; created reusable ETL templates and runbooks; supported large-scale cloud migration initiatives.

Senior Data Engineer at TriWest Healthcare Alliance (Avanade)

August 1, 2023 - November 21, 2025

Senior Data Engineer responsible for expanding and optimizing data and pipeline architectures, and for optimizing data collection and flow across functional teams. Designed and developed ETL pipelines using Azure Data Factory and Azure Databricks, streamlining processing across bronze, silver, and gold layers. Implemented data solutions using Azure Data Lake (ADLS Gen2), Delta tables, and integrated services with Snowflake for advanced analytics. Automated ingestion workflows with parameterized pipelines, reducing load times and improving data availability. Optimized Spark jobs by reducing shuffles and handling data skew. Implemented streaming pipelines in Databricks for near real-time data ingestion and monitoring. Developed reusable utilities for SCD processing and raw data ingestion, improving consistency and reducing maintenance overhead. Partnered with stakeholders to deliver Power BI reporting with optimized data models and incremental refresh. Used Delta Lake MERGE for increment

Senior Data Engineer at Microsoft (Avanade)

July 1, 2023 - July 1, 2023

Designed and developed ETL pipelines using Azure Data Factory to orchestrate data ingestion and transformation. Leveraged Azure Data Explorer to query and analyze log and telemetry data at scale. Partnered with business teams to build curated datasets in Power BI, enabling faster insights and improved decision-making through optimized star-schema models. Implemented incremental refresh and partition strategies in Synapse, resulting in enhanced query performance. Automated data quality validations and monitoring within ADF pipelines. Integrated Azure Data Lake and Delta tables with Synapse for hybrid analytics scenarios. Developed utilities for reusable transformations and parameterized pipelines to reduce maintenance, and leveraged Azure DevOps CI/CD pipelines for deployment.

Senior Data Engineer at Jp Morgan Chase

June 1, 2022 - June 1, 2022

Designed and maintained large-scale ETL pipelines using Ab Initio, processing critical financial and risk data across multiple business units. Migrated legacy ETL workloads into AWS Glue and S3, enabling scalable cloud-based data ingestion and transformation. Automated batch and near real-time data ingestion pipelines on AWS, improving timeliness of financial reporting. Built and optimized ETL jobs in Ab Initio to improve runtime performance and reduce operational costs. Leveraged Hive, HDFS, and other Big Data tools for processing high-volume datasets. Implemented data quality checks and reconciliation processes to ensure accuracy for regulatory and compliance reporting. Partnered with reporting teams to prepare curated datasets for Power BI and internal reporting tools. Created reusable ETL templates, technical design documents, and operational runbooks for consistent data processing. Worked with cross-functional teams to support large-scale cloud migration initiatives, moving from o