Available to hire
I am a data engineer with nearly four years of experience designing and developing Big Data applications using the Hadoop ecosystem (HDFS, Hive, Sqoop, Apache Spark) and AWS. I thrive on solving complex data processing needs, building scalable pipelines, and delivering actionable insights from large structured and semi-structured data. In my day-to-day, I enjoy collaborating with stakeholders, refining data models, and optimizing performance to drive cost efficiency.
I have hands-on experience across data ingestion, processing, and analysis, and I am comfortable with agile environments, data quality, and driving business impact with data solutions.
Work Experience
AWS Cloud Spark Developer at Tata Consultancy Services
December 1, 2021 - October 1, 2025Responsibilities included creating EC2 instances and EMR clusters for development and testing, performing step-wise deployment on EMR, loading data from Spark into Hive, and managing data with Sqoop between HDFS/Hive and RDBMS. I optimized Spark SQL queries to reduce costs, loaded and transformed large semi-structured data (XML, JSON, Avro, Parquet), created Hive tables with partitioning and bucketing, and supported data analysis and data quality efforts in collaboration with business teams. I also contributed to POCs using Apache Spark SQL.
Education
B.Tech at Vivekananda Institute of Technology and Sciences
January 1, 2018 - November 30, 2025Bachelor of Engineering at Nigama College of Engineering
January 1, 2015 - January 1, 2017High School at Little Angels High School
January 1, 2014 - January 1, 2015Qualifications
Industry Experience
Software & Internet, Professional Services
Hire a Data Scientist
We have the best data scientist experts on Twine. Hire a data scientist today.