I am a Senior Data Engineer with 8 years of experience building and optimizing data pipelines, data lakes, and analytics platforms across AWS, Azure, and GCP. I specialize in large-scale batch and real-time processing using Hadoop, Spark, Kafka, and cloud-native services, always focused on data quality, governance, and cost efficiency. I love collaborating with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets, scalable architectures, and robust CI/CD pipelines that improve decision-making and model accuracy.

Divya Sri

I am a Senior Data Engineer with 8 years of experience building and optimizing data pipelines, data lakes, and analytics platforms across AWS, Azure, and GCP. I specialize in large-scale batch and real-time processing using Hadoop, Spark, Kafka, and cloud-native services, always focused on data quality, governance, and cost efficiency. I love collaborating with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets, scalable architectures, and robust CI/CD pipelines that improve decision-making and model accuracy.

Available to hire

I am a Senior Data Engineer with 8 years of experience building and optimizing data pipelines, data lakes, and analytics platforms across AWS, Azure, and GCP. I specialize in large-scale batch and real-time processing using Hadoop, Spark, Kafka, and cloud-native services, always focused on data quality, governance, and cost efficiency.

I love collaborating with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets, scalable architectures, and robust CI/CD pipelines that improve decision-making and model accuracy.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
See more

Language

English
Fluent

Work Experience

Senior Data Engineer at Charter Communications
August 1, 2024 - Present
Designed, developed, and deployed reports in MS SQL Server using SSRS/SSIS; created parameterized stored procedures; formatted reports; designed scalable ETL pipelines on GCP (Cloud Dataflow, Apache Beam, Cloud Composer); automated ingestion of financial datasets from on-prem Oracle to Cloud Storage; migrated legacy ETL jobs to BigQuery; configured SSIS packages for multi-environment deployment; optimized performance and data models; collaborated with InfoSec on data security posture; led replacement of Excel-based risk scoring with a GCP-native data pipeline.
Senior Data Engineer at UnitedHealthcare
July 1, 2024 - October 15, 2025
Led Big Data Analytics in the Hadoop ecosystem (MapReduce, Spark, Hive, Pig, HBase, Kafka, Oozie); performed Hive tuning, implemented Spark transformations, and migrated MapReduce jobs to Spark; built data processing solutions on Azure Databricks and Data Lake Analytics; developed data pipelines using Azure Data Factory and Spark SQL; facilitated data migration to Snowflake; performed data validation and supported BI development across stakeholders.
Senior Data Engineer at Cardinal Health
December 1, 2021 - October 15, 2025
Designed AWS architecture and migration strategy; implemented AWS EMR, DynamoDB, Redshift; worked with Cloudera Hadoop on AWS; built Lambda-based event processing; used Sqoop for HDFS/Hive data ingestion; implemented Terraform/Ansible for infrastructure as code; deployed Docker containers with ECS; developed Spark jobs and created Snowflake end-user views for BI; led data migration planning and CI/CD via Jenkins.
Data Engineer at Krios Info Solutions
April 1, 2019 - October 15, 2025
Created architectures and data models to feed BI tools; built data pipelines to data lake and data warehouse; established auditing, error logging, and master data management for pipelines; migrated code from Datastage to Databricks and Azure Data Factory; parsed JSON with PySpark; implemented ETL in Azure Databricks; supported data issues and implemented CI/CD pipelines with Docker and Jenkins.
Senior Data Engineer at UnitedHealthcare
January 1, 2022 - July 1, 2024
Designed and maintained scalable data pipelines using PySpark, Python, and SQL to process healthcare and claims data across multiple sources; built ETL/ELT frameworks with AWS Glue, Airflow, and Databricks; architected data lake/warehouse on AWS to support analytics, risk modeling, and population health insights; integrated real-time and batch ingestion using Kafka and Kinesis; collaborated with data scientists and actuaries to prepare analytics datasets; implemented data quality frameworks (Great Expectations, dbt) and CI/CD pipelines; ensured HIPAA/PHI security.
Data Engineer at Cardinal Health
August 1, 2019 - December 1, 2021
Designed AWS architecture, cloud migration, EMR, DynamoDB, and Redshift; developed data integration workflows using Informatica, Airflow, and AWS Glue; collaborated on star-schema and dimensional modeling in Snowflake/Redshift; implemented data quality and governance with Great Expectations and AWS Glue Data Catalog; built real-time streaming for orders, shipments, and customer data; containerized Spark and Python jobs with Docker and Kubernetes; established data lineage and metadata management; ensured HIPAA compliance.
Data Engineer at Krios Info Solutions
July 1, 2017 - April 1, 2019
Built data pipelines and integration solutions for enterprise clients using Informatica, Talend, and SSIS; developed data models in Oracle and SQL Server; automated ingestion and cleansing processes; implemented data transformation and analytics for reporting; monitored ETL jobs and resolved performance issues; participated in Agile sprints and contributed to data governance and metadata creation.

Education

Bachelor's in Computer Science & Engineering at Geethanjali Institute of Science and Technology Nellore, India
January 1, 2013 - January 1, 2017
Bachelor’s in Computer Science & Engineering at Geethanjali Institute of Science and Technology
January 1, 2013 - January 1, 2017

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Professional Services, Healthcare, Financial Services, Telecommunications