Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Hi, I’m Nisha Pedsangi, a Data Engineer with 3.5 years of experience building scalable data pipelines using PySpark, SQL, Azure Data Factory, and Databricks. I thrive on turning complex data into reliable analytics-ready solutions that empower business decisions and AI initiatives. I’ve led migrations of legacy ETL jobs to modern platforms, implemented Delta Lake on ADLS, and built reusable data transformations. I’m passionate about data quality, compliance, and collaborating with cross-functional teams to deliver production-ready solutions.…Hi, I’m Nisha Pedsangi, a Data Engineer with 3.5 years of experience building scalable data pipelines using PySpark, SQL, Azure Data Factory, and Databricks. I thrive on turning complex data into reliable analytics-ready solutions that empower business decisions and AI initiatives. I’ve led migrations of legacy ETL jobs to modern platforms, implemented Delta Lake on ADLS, and built reusable data transformations. I’m passionate about data quality, compliance, and collaborating with cross-functional teams to deliver production-ready solutions.

Nisha Pedsangi

Data Scientist, Data Visualizer, AI Engineer





Hi, I’m Nisha Pedsangi, a Data Engineer with 3.5 years of experience building scalable data pipelines using PySpark, SQL, Azure Data Factory, and Databricks. I thrive on turning complex data into reliable analytics-ready solutions that empower business decisions and AI initiatives. I’ve led migrations of legacy ETL jobs to modern platforms, implemented Delta Lake on ADLS, and built reusable data transformations. I’m passionate about data quality, compliance, and collaborating with cross-functional teams to deliver production-ready solutions.…Hi, I’m Nisha Pedsangi, a Data Engineer with 3.5 years of experience building scalable data pipelines using PySpark, SQL, Azure Data Factory, and Databricks. I thrive on turning complex data into reliable analytics-ready solutions that empower business decisions and AI initiatives. I’ve led migrations of legacy ETL jobs to modern platforms, implemented Delta Lake on ADLS, and built reusable data transformations. I’m passionate about data quality, compliance, and collaborating with cross-functional teams to deliver production-ready solutions.

Available to hire

Hi, I’m Nisha Pedsangi, a Data Engineer with 3.5 years of experience building scalable data pipelines using PySpark, SQL, Azure Data Factory, and Databricks. I thrive on turning complex data into reliable analytics-ready solutions that empower business decisions and AI initiatives.

I’ve led migrations of legacy ETL jobs to modern platforms, implemented Delta Lake on ADLS, and built reusable data transformations. I’m passionate about data quality, compliance, and collaborating with cross-functional teams to deliver production-ready solutions.

Skills

Experience Level

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Sr Associate Engineer at American Airlines

January 1, 2025 - Present

Designed and developed scalable data pipelines using Azure Data Factory, Databricks, and PySpark to ingest and transform large-volume batch data from diverse structured and semi-structured sources. Implemented Delta Lake and Azure Data Lake Storage–based data architectures with optimized partitioning, caching, and performance tuning to support efficient analytics. Developed reusable PySpark transformations and SQL-based data validation checks to maintain data quality, consistency, and compliance across the data lifecycle. Built AI-ready datasets by removing PII-sensitive fields and filtering non-English content to ensure compliance, data quality, and suitability for downstream ML and human emotion analysis models.

Associate Data Engineer at Teradata

January 1, 2022 - January 1, 2025

Migrated 60+ legacy IBM DataStage jobs to Databricks using PySpark & SQL for American Airlines, reducing ETL runtime by 30% and improving reliability. Built event-driven pipelines using ADF and Databricks to automate data transformation workflows. Developed reusable, parameterized PySpark notebooks to transform raw data into curated datasets in ADLS. Orchestrated dependency-aware workflows in ADF, improving operational stability and maintainability. Collaborated with cross-functional teams to modernize the data platform; contributed to best practices and documentation.