Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am a data-focused professional with nearly a decade of experience turning complex data problems into scalable solutions. I love building robust data architectures and modernizing data platforms to enable informed decision-making. I thrive in challenging environments and enjoy collaborating with cross-functional teams to deliver measurable business impact using technologies like Airflow, AWS, Snowflake, Docker, Kubernetes, and DBT.…I am a data-focused professional with nearly a decade of experience turning complex data problems into scalable solutions. I love building robust data architectures and modernizing data platforms to enable informed decision-making. I thrive in challenging environments and enjoy collaborating with cross-functional teams to deliver measurable business impact using technologies like Airflow, AWS, Snowflake, Docker, Kubernetes, and DBT.

Anoop Upadhyay

Data Scientist, Full Stack Developer, Cloud Developer, +2





I am a data-focused professional with nearly a decade of experience turning complex data problems into scalable solutions. I love building robust data architectures and modernizing data platforms to enable informed decision-making. I thrive in challenging environments and enjoy collaborating with cross-functional teams to deliver measurable business impact using technologies like Airflow, AWS, Snowflake, Docker, Kubernetes, and DBT.…I am a data-focused professional with nearly a decade of experience turning complex data problems into scalable solutions. I love building robust data architectures and modernizing data platforms to enable informed decision-making. I thrive in challenging environments and enjoy collaborating with cross-functional teams to deliver measurable business impact using technologies like Airflow, AWS, Snowflake, Docker, Kubernetes, and DBT.

Available to hire

I am a data-focused professional with nearly a decade of experience turning complex data problems into scalable solutions. I love building robust data architectures and modernizing data platforms to enable informed decision-making.

I thrive in challenging environments and enjoy collaborating with cross-functional teams to deliver measurable business impact using technologies like Airflow, AWS, Snowflake, Docker, Kubernetes, and DBT.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Language

English

Fluent

Hindi

Advanced

Work Experience

Data Architect (Analytics /ETL/AWS Cloud) at Petco Health and Wellness Company, Inc.

October 1, 2023 - November 2, 2025

Leading a data modernization initiative using Airflow, AWS, Snowflake, Docker, Kubernetes and DBT to design scalable, fault-tolerant data pipelines. Designed and implemented event-triggered pipelines with EventBridge, Lambda, Airflow, Snowflake and DBT. Led real-time data streaming to move data across systems using MSK, Lambda, EC2, CloudWatch, EKS, ECR, Docker, Java, and Snowflake Streaming API. Wrote DBT models for business transformation against Snowflake data warehouse for ML and analytics needs.

Senior Data Engineer (Analytics /ETL/AWS Cloud) at Fanatics e-commerce India LLP

October 1, 2023 - October 1, 2023

Used Airflow, AWS, Snowflake and Python to build data pipelines. Implemented analytics to soft-allocate customer orders and identify orders at risk. Led a team of data engineers to build scalable and fault-tolerant pipelines for the wholesale business. Conducted code/design reviews and enforced coding standards.

Software Engineer (Big Data/Analytics/Machine Learning/AWS Cloud) at OptumInsight India Pvt. Ltd.

February 1, 2022 - February 1, 2022

Used Apache Spark, Hive, Scala and Python for development of insurance claims anomaly detection and pattern analysis platform. Developed a domain-specific language using Python's lark-parser to write rules on top of data. Worked on CI/CD pipelines for automated deployment and execution.

Application Developer (Big Data/BI/ETL/Analytics) at Oracle India Pvt. Ltd.

August 1, 2019 - August 1, 2019

Used Apache Kafka, Oracle GoldenGate and Java for rapid conversion of legacy ETL to real-time data pipeline by introducing Lambda architecture. Designed, developed and modified data extraction and transformation routines for data warehouses using Spark SQL. Created models for new data warehouses and cloud movement. Enhanced report performances by tuning derived tables and join structures.

Assistant System Engineer (Big Data/Analytics) at Tata Consultancy Services (DESS -TCS Digital Enterprise solution services)

June 1, 2017 - June 1, 2017

Used Apache Spark, Sqoop and Java for development of data migration tools and reconciliation. Used Spark, Hive and Scala for ingestion of data from legacy systems into Hadoop ecosystem followed by transformation for BI analysis. Focused on application performance maintenance and incident resolution.