Available to hire
I’m Varun Kumar Kandukuri, a data engineer with 4+ years of experience designing and delivering data warehousing solutions. I excel at transforming complex datasets into actionable insights using Databricks, Python, PySpark, and SQL, and I thrive on building scalable data pipelines.
I’m proficient across cloud platforms (AWS and Azure), data modeling and governance, HIPAA/GDPR/CCPA compliance, and real-time data processing. I enjoy collaborating with cross-functional teams to drive analytics, optimize data workflows, and deliver secure, high-quality data products.
Skills
Work Experience
Data Engineer at Optum
December 1, 2023 - October 31, 2025Designed and managed databases using AWS RDS (PostgreSQL, MySQL) and NoSQL platforms (DynamoDB, MongoDB); built scalable data pipelines with Databricks and PySpark; automated provisioning, backup, and monitoring; developed Snowflake ELT pipelines with DBT; implemented CI/CD through Jenkins, GitLab, CodePipeline/CodeDeploy; created Power BI dashboards to visualize analytics.
Data Engineer at HSBC
August 1, 2023 - August 1, 2023Designed scalable data solutions with AWS Redshift, Glue, and Lambda; migrated health data to AWS using Snowball and DMS; implemented GDPR/CCPA governance using Lake Formation and IAM; optimized pipelines with Apache Kafka and Airflow; built healthcare claims pipelines into Snowflake; implemented automated data validation and QA processes.
Associate Data Engineer at LTI Mindtree
June 1, 2022 - June 1, 2022Developed large-scale entity resolution pipelines, built and maintained DAGs in Apache Airflow; integrated real-time data streams with Apache Kafka; processed datasets with Databricks and Spark; established governance and quality checks using Collibra; created Power BI and Looker dashboards for inventory and pricing insights.
Education
Master of Science in Information Systems at Cleveland State University
August 1, 2023 - May 1, 2025Bachelor of Technology in Mechanical Engineering at Vidya Jyothi Institute of Technology
June 1, 2018 - September 1, 2022Qualifications
AWS Certified Data Engineer
January 11, 2030 - October 31, 2025Python Certification
January 11, 2030 - October 31, 2025SQL Certification
January 11, 2030 - October 31, 2025Snowflake Certification
January 11, 2030 - October 31, 2025Databricks Certification
January 11, 2030 - October 31, 2025Industry Experience
Healthcare, Financial Services, Software & Internet, Professional Services, Retail
Skills
Hire a Data Scientist
We have the best data scientist experts on Twine. Hire a data scientist in Cleveland today.