Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am a Senior Data Engineer with 10+ years of experience delivering high-performance, scalable, cloud-native data systems. I specialize in Python, PySpark, Pandas, SQL, and Azure-based ETL pipelines (ADF, Databricks, Synapse) to architect robust data platforms that empower analytics and business insights. I enjoy collaborating with data scientists, analysts, and product teams to transform raw data into reliable, governed, and actionable insights. I’m passionate about automation, CI/CD for data platforms, and ensuring secure, compliant access to data across hybrid and cloud environments.…I am a Senior Data Engineer with 10+ years of experience delivering high-performance, scalable, cloud-native data systems. I specialize in Python, PySpark, Pandas, SQL, and Azure-based ETL pipelines (ADF, Databricks, Synapse) to architect robust data platforms that empower analytics and business insights. I enjoy collaborating with data scientists, analysts, and product teams to transform raw data into reliable, governed, and actionable insights. I’m passionate about automation, CI/CD for data platforms, and ensuring secure, compliant access to data across hybrid and cloud environments.

Vinay Addiga

Data Analyst, Data Scientist, Full Stack Developer, +2





I am a Senior Data Engineer with 10+ years of experience delivering high-performance, scalable, cloud-native data systems. I specialize in Python, PySpark, Pandas, SQL, and Azure-based ETL pipelines (ADF, Databricks, Synapse) to architect robust data platforms that empower analytics and business insights. I enjoy collaborating with data scientists, analysts, and product teams to transform raw data into reliable, governed, and actionable insights. I’m passionate about automation, CI/CD for data platforms, and ensuring secure, compliant access to data across hybrid and cloud environments.…I am a Senior Data Engineer with 10+ years of experience delivering high-performance, scalable, cloud-native data systems. I specialize in Python, PySpark, Pandas, SQL, and Azure-based ETL pipelines (ADF, Databricks, Synapse) to architect robust data platforms that empower analytics and business insights. I enjoy collaborating with data scientists, analysts, and product teams to transform raw data into reliable, governed, and actionable insights. I’m passionate about automation, CI/CD for data platforms, and ensuring secure, compliant access to data across hybrid and cloud environments.

Available to hire

I am a Senior Data Engineer with 10+ years of experience delivering high-performance, scalable, cloud-native data systems. I specialize in Python, PySpark, Pandas, SQL, and Azure-based ETL pipelines (ADF, Databricks, Synapse) to architect robust data platforms that empower analytics and business insights.

I enjoy collaborating with data scientists, analysts, and product teams to transform raw data into reliable, governed, and actionable insights. I’m passionate about automation, CI/CD for data platforms, and ensuring secure, compliant access to data across hybrid and cloud environments.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Sr. Data Engineer at Lowe's Companies

December 1, 2023 - November 6, 2025

Led the design and deployment of 5+ serverless data automation solutions using Azure Functions, streamlined ETL workflows, and reduced manual processing by 40%. Coordinated 25+ ETL workflows in Azure Data Factory, improving pipeline efficiency and reliability across multiple systems. Leveraged Azure Databricks and Spark for large-scale transformations, optimized ADLS with partitioning and lifecycle management, and established data governance using Azure Purview. Built 15+ Python/PySpark ETL pipelines and implemented real-time ingestion with Azure Stream Analytics and Event Hubs. Implemented Delta Lake for incremental processing, secured data with AAD and Key Vault, and automated CI/CD for ADF/Databricks via Azure DevOps. Led metadata management, data quality controls, and documentation; collaborated in Agile sprints with Jira. Architected and optimized Azure Synapse environments to accelerate analytics and reporting. Ensured data integrity across 50+ data sources.

Data Engineer at CarMax

November 30, 2023 - November 30, 2023

Utilized Azure Databricks and Spark for large-scale distributed transformations, improving ETL efficiency and reducing processing times. Integrated Azure Event Hubs and Kafka for real-time streaming. Designed serverless ETL architectures with Azure Functions and Logic Apps, and managed Azure SQL Database and ADLS for high-performance analytics. Developed and optimized 10+ ADF pipelines, automated ingestion with Python SDKs, and architected scalable storage in ADLS. Implemented RBAC and Purview for governance, and designed ELT workflows using Synapse for faster analytics. Implemented CI/CD pipelines with Jenkins and Terraform, and achieved cost optimization through pipeline tuning.

Data Engineer at T. Rowe Price

March 31, 2021 - March 31, 2021

Led AWS Glue PySpark ETL pipelines, designed optimized data models in Redshift and Snowflake, and engineered scalable data lakes on S3 with Lake Formation. Enabled real-time analytics with Kinesis and Kafka, enhanced data ingestion and processing performance, and automated deployment using CodePipeline/CodeBuild. Worked with PySpark and Python for data transformations and contributed to governance and monitoring. Created dashboards and data products to support analytics across business units.

Jr. Data Engineer at Prudential Financial

December 31, 2018 - December 31, 2018

Managed the complete lifecycle of Azure-based ETL pipelines from design through implementation, delivering scalable data solutions. Leveraged Azure Databricks and Spark for distributed processing, automated ETL via Airflow/ADF, and implemented RBAC with Managed Identities. Built ELT workflows with Databricks, Synapse, and ADF; ensured data governance with Purview and improved data security using AAD and Key Vault. Implemented CI/CD through Azure DevOps and Terraform; documented architectures and collaborated in Agile sprints.

Data Analyst at MetLife

June 30, 2015 - June 30, 2015

Designed and maintained interactive dashboards (Tableau) and wrote optimized SQL queries for PostgreSQL and MongoDB. Performed descriptive analytics, data cleaning with Python (Pandas/NumPy), and participated in data governance using AWS S3/RDS and Hadoop. Automated ETL workflows and leveraged cloud data storage solutions; contributed to data-driven decision making and business operations.