Available to hire
I am a results-oriented Data Engineer with 8+ years of experience designing, developing, and optimizing large-scale data pipelines across cloud, distributed, and real-time ecosystems.
I specialize in Python, Spark, SQL, Hive, and Airflow, with a strong foundation in data modeling, ETL orchestration, and data warehouse optimization on GCP, AWS, and Snowflake. I thrive in collaborative, fast-paced environments and enjoy delivering production-grade data solutions that empower business decisions.
Skills
See more
Language
English
Fluent
Hindi
Fluent
Bengali
Intermediate
Work Experience
Sr. Data Engineer at Target Corporation
July 1, 2024 - PresentExperienced Data Engineer in the retail domain, specializing in building and orchestrating scalable data pipelines using Spark, Hive, and Python for large-volume processing and analytics. Led GCP migration initiatives and delivered ad hoc SQL solutions to support business intelligence and reporting needs, including Looker dashboard for visualization. Developed microservices using Java and contributed to MVP data products, ensuring high-performance, cloud-native, and production-grade data ecosystems.
Software Engineer - Data at Algonomy
July 1, 2024 - October 17, 2025Engineered and optimized data pipelines and ETL workflows using Airflow, PySpark, and AWS (S3, Redshift, Athena, Aurora) to enable seamless data movement and processing. Developed custom Airflow operators, sensors, and real-time monitoring systems integrating DAG and EC2 status APIs for enhanced alerting and reliability. Designed SQL-based views and Tableau dashboards to transform complex datasets into actionable business insights and data-driven decisions.
Data Engineer at Deloitte USI
December 1, 2021 - October 17, 2025Contributed to the successful execution of a Data Warehouse Migration initiative for a US Healthcare organization, ensuring seamless transition and optimized data architecture. Designed and implemented a robust data pipeline leveraging the Snowflake ecosystem — including Snowpipe, Tasks, Streams, and Stored Procedures — to efficiently move data from Teradata and FTP sources into Snowflake. Developed advanced PySpark scripts to implement complex business logic, enabling precise data deduplication, validation, and enhanced data quality assurance.
Data Engineer at Mindtree Limited
April 1, 2021 - October 17, 2025Collaborated with Data Scientists to develop ad hoc Python scripts for a Retail client, enabling faster data exploration and model validation. Partnered with stakeholders to gather and translate business requirements into efficient, production-ready data engineering solutions. Optimized an on-demand EC2-based architecture to a spot instance model, achieving 70% cost savings while maintaining performance and reliability.
Education
B.Tech at Asnasol Engineering College, Asansol, West Bengal
August 1, 2014 - July 1, 2018Qualifications
Industry Experience
Retail, Software & Internet, Healthcare
Working as freelance data engineer for past 5 years
Hire a Data Analyst
We have the best data analyst experts on Twine. Hire a data analyst in Bengaluru today.