Available to hire
I am Vineeth Kumar, a Senior Data Engineer with over eight years of hands-on experience building scalable data platforms, streaming pipelines, and analytics solutions across Azure, AWS, Snowflake, and Databricks.
I thrive when turning complex data requirements into well-governed architectures, collaborating with cross-functional teams to deliver reliable data models, automated validations, and performance-tuned pipelines.
Language
English
Advanced
Work Experience
Senior Data Engineer at Northern Trust
August 1, 2025 - August 1, 2025Designed and implemented scalable ETL/ELT pipelines in Snowflake and Databricks, integrating structured and semi-structured data from Azure and AWS; built real-time streaming pipelines with Kafka, Azure Event Hubs, and Spark Structured Streaming; implemented Data Vault models for auditable data warehousing; developed robust error handling and data validation frameworks; deployed Databricks jobs/clusters with autoscaling; automated data ingestion from CSV, Excel, APIs, and cloud storage; orchestrated workflows using Apache Airflow; implemented data sharing governance via Snowflake Secure Data Sharing and Delta Sharing; leveraged Azure Key Vault for secret management; created end-to-end pipelines with ADF, Spark SQL, and dbt.
Senior Data Engineer at Credit Acceptance
June 1, 2024 - June 1, 2024Developed PySpark scripts on Azure HDInsight for data aggregation and validation; migrated data to HDFS from web server outputs; implemented Delta Lake pipelines in Databricks with Airflow; created reusable Airflow operators/hooks to trigger Databricks jobs and integrate with Snowflake and downstream systems; improved pipeline reliability with automated testing and retry logic; handled missing data/outliers with Pandas; performed time-series analysis.
Data Engineer at Health Care Service Corporation
April 1, 2022 - April 1, 2022Migrated on-prem data to Azure Synapse Analytics using Azure Data Factory; built ADF pipelines; implemented Delta Live Tables for real-time data change tracking and processing; leveraged Delta Live Tables for managing streaming data sources; performed Kafka analysis and Spark ML workflows; migrated SSIS to Snowflake; implemented CI/CD and data sharing strategies; deployed Delta sharing for secure data exchange.
Big Data Engineer at Express Scripts
April 1, 2021 - April 1, 2021Worked with Databricks Unified Analytics Platform for big data analytics; set up and managed Databricks clusters; designed and implemented data pipelines with Delta Live Tables; data migration to Snowflake; automated testing and CI/CD pipelines; built streaming pipelines using Kafka/Event Hub; created dashboards in Tableau/PowerBI; collaborated with teams on data governance and lineage.
Big Data Engineer at American International Group
July 1, 2019 - July 1, 2019Designed data integration workflows on Hadoop ecosystem (Hadoop, Spark, Hive, HBase); developed Hive and Sqoop data ingestion from RDBMS to Hadoop staging; built data lake ingestion and processing pipelines; created MapReduce/Hive programs; managed Agile processes; implemented Oozie workflows; migrated or integrated data with Snowflake-based workflows and Delta sharing as applicable.
Education
Master of Science, Computational Data Science at Kent State University
January 11, 2030 - October 31, 2025Bachelor of Science, Computer Science at JBIT University
January 11, 2030 - October 31, 2025Qualifications
SnowPro Core certified
January 11, 2030 - October 31, 2025Microsoft Azure AZ-900 Fundamentals
January 11, 2030 - October 31, 2025Industry Experience
Financial Services, Software & Internet, Healthcare
Hire a Database Developer
We have the best database developer experts on Twine. Hire a database developer in Chicago today.