Senior Data Engineer with 9+ years of experience designing and implementing end-to-end data engineering solutions across cloud and big data platforms. Skilled in building ETL/ELT pipelines, data warehouses, and real-time analytics using Python, SQL, and major cloud services. Experienced in healthcare and financial domains, with strong expertise in Azure/GCP data services, governance and security (Azure AD/GCP IAM), containerized environments (Docker), and continuous integration/deployment (Azure DevOps/GitLab/CI/CD). Builds analytics dashboards and applies machine learning (TensorFlow/PyTorch) to drive predictive and operational insights.

CHAITANYA REDDY SANE

Senior Data Engineer with 9+ years of experience designing and implementing end-to-end data engineering solutions across cloud and big data platforms. Skilled in building ETL/ELT pipelines, data warehouses, and real-time analytics using Python, SQL, and major cloud services. Experienced in healthcare and financial domains, with strong expertise in Azure/GCP data services, governance and security (Azure AD/GCP IAM), containerized environments (Docker), and continuous integration/deployment (Azure DevOps/GitLab/CI/CD). Builds analytics dashboards and applies machine learning (TensorFlow/PyTorch) to drive predictive and operational insights.

Available to hire

Senior Data Engineer with 9+ years of experience designing and implementing end-to-end data engineering solutions across cloud and big data platforms. Skilled in building ETL/ELT pipelines, data warehouses, and real-time analytics using Python, SQL, and major cloud services.

Experienced in healthcare and financial domains, with strong expertise in Azure/GCP data services, governance and security (Azure AD/GCP IAM), containerized environments (Docker), and continuous integration/deployment (Azure DevOps/GitLab/CI/CD). Builds analytics dashboards and applies machine learning (TensorFlow/PyTorch) to drive predictive and operational insights.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Work Experience

Sr. Data Engineer at QTC, San Antonio, TX
February 1, 2025 - Present
Developed healthcare data pipelines using Google Data Fusion to integrate and process diverse datasets. Managed large-scale analytics workloads on Google Cloud Storage with emphasis on availability and security. Implemented data governance and access controls using Google Cloud IAM and standardized metadata management via Cloud Data Catalog. Built cloud data warehousing solutions using Snowflake to improve scalability and query performance. Developed predictive machine learning models for patient outcome forecasting using PyTorch and optimized SQL queries for healthcare research and operational reporting. Automated data workflows using Python and event-driven/serverless components (Google Cloud Functions). Implemented real-time messaging with Google Cloud Pub/Sub and streaming/processing integrations with Google Dataflow. Created dashboards and reporting via Google Data Studio and supported database performance tuning on Google Cloud SQL. Used Terraform for infrastructure provisioning
Data Engineer at Lincoln Financial Group, Greensboro, NC
April 1, 2022 - January 1, 2025
Designed and delivered financial data solutions using Azure SQL Database based on business requirements. Built and optimized data integration pipelines with Azure Data Factory and implemented real-time processing using Azure Stream Analytics for faster decision support. Deployed and managed Docker containers to standardize development environments. Implemented Snowflake for cloud data warehousing to improve storage, access, and analytics capabilities, including Snowflake data cloning for safe testing. Integrated Azure Active Directory for secure authentication and access controls. Developed predictive forecasting models using PyTorch for financial planning and risk management. Produced executive dashboards and reports using Tableau. Automated ETL workflows with SSIS and serverless processing using Azure Functions. Utilized ADLS for scalable data lake storage and Azure Cosmos DB for globally distributed, low-latency financial applications. Integrated messaging/workflow using Azure Servi
Data Pipeline Engineer at ArganoKeste, Plano, TX
May 1, 2020 - March 1, 2022
Designed robust data pipelines using Apache Beam to improve processing and integration for IT services. Automated and optimized ETL processes using Talend to increase accuracy and efficiency. Configured Azure Data Factory pipelines for streamlined ingestion and transformation. Leveraged Azure HDInsight for large-scale data processing and analytics. Managed Azure SQL Database implementations with performance and scalability improvements, and supported secure data access via encryption policies in Azure Storage. Used Azure Cosmos DB for globally distributed data availability and reduced latency. Deployed applications with Docker for consistent dev/test/prod environments and worked with Databricks for advanced analytics and machine learning workloads. Implemented real-time streaming and insights through Azure Stream Analytics. Administered authentication and access management using Azure Active Directory. Managed CI/CD workflows with Azure DevOps and documentation/knowledge transfer acros
Business Analyst at Sovereign Infotech India Pvt Ltd, Coimbatore, India
June 1, 2018 - January 1, 2020
Analyzed business processes using R and Python to identify opportunities for improvement and data-driven decision-making. Managed and queried data warehouses in Amazon Redshift to enhance analytics capabilities. Built interactive dashboards and reports with Tableau to support strategic decisions. Automated data workflows with Apache Airflow for efficient data collection and analysis. Used Git for version control and collaboration. Conducted analytics and reporting using Excel and MS SQL, including complex SQL development. Applied statistical techniques to identify trends, patterns, and anomalies. Facilitated business meetings with stakeholders to refine data findings and strategy, and delivered analytics training to team members. Ensured data security and compliance using best practices and documented processes for audits. Managed project timelines using Agile methodologies and collaborated with IT to improve data infrastructure scalability and robustness.
Data Analytics Engineer at OLR India Pvt Ltd, Bangalore, India
December 1, 2016 - May 1, 2018
Built and integrated diverse data sources into a PostgreSQL-based data warehouse to improve accessibility. Performed advanced analytics using Microsoft Excel and supported analytics projects with Python libraries such as pandas and NumPy. Developed dashboards and visualizations using QlikView and Tableau. Used Apache Hive for managing and querying large datasets. Authored documentation for analytics processes and ensured consistent data management practices. Implemented complex SQL queries and performed data quality checks to ensure accuracy and reliability. Used GitLab for source code management and version control. Optimized data models and schemas to improve performance and scalability and ensured compliance with data governance and privacy standards. Collaborated with cross-functional teams to deliver tailored analytics solutions, trained team members, and managed deliverables according to project schedules.

Education

Bachelor of Technology (B. Tech) in Information Technology at JNTUH, Hyderabad, Telangana, India
January 1, 2017 - December 31, 2017

Qualifications

Add your qualifications or awards here.

Industry Experience

Healthcare, Financial Services, Software & Internet, Professional Services