Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am a Senior Data Engineer with over 7 years of experience designing, building, and optimizing cloud-native data platforms and large-scale data solutions across Azure, AWS, and GCP. I specialize in building scalable ETL/ELT pipelines, real-time and batch data processing workflows, and delivering actionable BI visualizations to empower analytics and AI/ML initiatives. My background includes deep expertise in Spark, Snowflake, Azure Databricks, Apache Airflow, and cloud infrastructure as code. I enjoy collaborating with cross-functional teams and stakeholders to translate business needs into efficient, compliant, and high-performance data architectures that drive real business value.…I am a Senior Data Engineer with over 7 years of experience designing, building, and optimizing cloud-native data platforms and large-scale data solutions across Azure, AWS, and GCP. I specialize in building scalable ETL/ELT pipelines, real-time and batch data processing workflows, and delivering actionable BI visualizations to empower analytics and AI/ML initiatives. My background includes deep expertise in Spark, Snowflake, Azure Databricks, Apache Airflow, and cloud infrastructure as code. I enjoy collaborating with cross-functional teams and stakeholders to translate business needs into efficient, compliant, and high-performance data architectures that drive real business value.

Shailaja Reddy

Developer, Programmer, Cloud Developer, +1





I am a Senior Data Engineer with over 7 years of experience designing, building, and optimizing cloud-native data platforms and large-scale data solutions across Azure, AWS, and GCP. I specialize in building scalable ETL/ELT pipelines, real-time and batch data processing workflows, and delivering actionable BI visualizations to empower analytics and AI/ML initiatives. My background includes deep expertise in Spark, Snowflake, Azure Databricks, Apache Airflow, and cloud infrastructure as code. I enjoy collaborating with cross-functional teams and stakeholders to translate business needs into efficient, compliant, and high-performance data architectures that drive real business value.…I am a Senior Data Engineer with over 7 years of experience designing, building, and optimizing cloud-native data platforms and large-scale data solutions across Azure, AWS, and GCP. I specialize in building scalable ETL/ELT pipelines, real-time and batch data processing workflows, and delivering actionable BI visualizations to empower analytics and AI/ML initiatives. My background includes deep expertise in Spark, Snowflake, Azure Databricks, Apache Airflow, and cloud infrastructure as code. I enjoy collaborating with cross-functional teams and stakeholders to translate business needs into efficient, compliant, and high-performance data architectures that drive real business value.

Available to hire

I am a Senior Data Engineer with over 7 years of experience designing, building, and optimizing cloud-native data platforms and large-scale data solutions across Azure, AWS, and GCP. I specialize in building scalable ETL/ELT pipelines, real-time and batch data processing workflows, and delivering actionable BI visualizations to empower analytics and AI/ML initiatives.

My background includes deep expertise in Spark, Snowflake, Azure Databricks, Apache Airflow, and cloud infrastructure as code. I enjoy collaborating with cross-functional teams and stakeholders to translate business needs into efficient, compliant, and high-performance data architectures that drive real business value.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Work Experience

Senior Data Engineer at Morgan Stanley

September 1, 2022 - Present

Lead development of Azure Logic Apps workflows and Azure Functions for real-time pipeline automation. Built monitoring dashboards reducing performance bottlenecks, authored key documentation for team onboarding, and accelerated predictive modeling via Azure Databricks. Delivered interactive Power BI dashboards adopted by 200+ users and integrated Azure Event Hub with Azure Data Lake for fault-tolerant streaming ingestion. Orchestrated pipelines with Apache Airflow, optimized Azure Synapse designs, and automated HDInsight scaling reducing costs by 25%. Developed serverless Spark apps and optimized AWS CI/CD pipelines, engineered sub-second latency real-time streaming with PySpark and Kafka, and expanded analytics to multi-cloud platforms including GCP.

Data Engineer at USAA

August 31, 2022 - August 26, 2025

Architected scalable cloud data platforms using Azure, AWS, and Snowflake, optimizing cross-region availability and cost-efficiency. Built real-time ingestion pipelines with Apache Airflow and Azure Data Factory and automated ETL/ELT workflows transforming large datasets for multi-cloud warehousing. Developed SSIS pipelines increasing reliability and reduced query times on large workloads by 30%+. Implemented governance with AWS Glue Catalog and DBT, designed dashboards for 200+ users, and monitored workloads with Azure Monitor and AWS CloudWatch. Extended capabilities to GCP enabling hybrid analytics and applied security and compliance best practices across environments.

Data Engineer at Deloitte

January 31, 2020 - August 26, 2025

Designed and implemented ETL pipelines with Informatica PowerCenter and SSIS for high-quality, consistent datasets. Led enterprise Hadoop HDFS data lake design integrating Hive, MapReduce, and Sqoop. Developed real-time streaming pipelines with Kafka and Spark Streaming, reducing ETL runtimes by up to 40%. Automated workflows using Apache Airflow reducing manual effort by over 20 hours weekly. Improved SQL Server performance by 30-50% and established data governance with Apache Atlas. Monitored Hadoop clusters for performance, designed scalable data models, and created Tableau dashboards translating big data to actionable insights.

Python Developer/ Software Engineer at Motorola Solutions

July 31, 2018 - August 26, 2025

Optimized SQL Server databases for efficient data retrieval and reporting, developing dynamic SQL scripts and stored procedures. Created Flask-based web applications supporting real-time processing and high availability. Utilized Python libraries for data manipulation and statistical analysis. Built CI/CD pipelines using Jenkins and Git, automated deployments, and integrated Python applications with MySQL databases. Automated cloud resource provisioning and supported UNIX environments via shell scripting, improving ETL performance by up to 30%. Developed monitoring scripts reducing downtime and collaborated with stakeholders to deliver scalable data solutions.