Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I'm a Senior Data Engineer with 10+ years of experience designing, implementing, and optimizing scalable data systems across AWS, Azure, and GCP. I specialize in building robust ETL pipelines, data lakes, and analytics platforms that empower teams to make data-driven decisions. I thrive on mentoring teams, delivering high-quality solutions, and applying ML and AI techniques to real-world data challenges. I value collaboration, practical engineering, and continuous learning.…I'm a Senior Data Engineer with 10+ years of experience designing, implementing, and optimizing scalable data systems across AWS, Azure, and GCP. I specialize in building robust ETL pipelines, data lakes, and analytics platforms that empower teams to make data-driven decisions. I thrive on mentoring teams, delivering high-quality solutions, and applying ML and AI techniques to real-world data challenges. I value collaboration, practical engineering, and continuous learning.

Prasad Wagle

Web Developer, Full Stack Developer, Back-End Developer, +2





I'm a Senior Data Engineer with 10+ years of experience designing, implementing, and optimizing scalable data systems across AWS, Azure, and GCP. I specialize in building robust ETL pipelines, data lakes, and analytics platforms that empower teams to make data-driven decisions. I thrive on mentoring teams, delivering high-quality solutions, and applying ML and AI techniques to real-world data challenges. I value collaboration, practical engineering, and continuous learning.…I'm a Senior Data Engineer with 10+ years of experience designing, implementing, and optimizing scalable data systems across AWS, Azure, and GCP. I specialize in building robust ETL pipelines, data lakes, and analytics platforms that empower teams to make data-driven decisions. I thrive on mentoring teams, delivering high-quality solutions, and applying ML and AI techniques to real-world data challenges. I value collaboration, practical engineering, and continuous learning.

Available to hire

I’m a Senior Data Engineer with 10+ years of experience designing, implementing, and optimizing scalable data systems across AWS, Azure, and GCP. I specialize in building robust ETL pipelines, data lakes, and analytics platforms that empower teams to make data-driven decisions.

I thrive on mentoring teams, delivering high-quality solutions, and applying ML and AI techniques to real-world data challenges. I value collaboration, practical engineering, and continuous learning.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Java

Intermediate

Work Experience

Senior Big Data Engineer at Cognizant and HMRC

September 1, 2025 - September 1, 2025

Led and mentored a team of data engineers, providing technical guidance, performance reviews, and career development support. Designed and optimized ETL processes using Hadoop and Spark to handle large volumes of structured, semi-structured, and unstructured data. Architected scalable, secure, and cost-efficient data solutions across AWS, Azure, and GCP (Azure DataBricks, Azure Synapse, and BigQuery) for advanced analytics. Built and optimized Databricks pipelines with Delta Lake, Spark ML, and ADLS Gen2; automated end-to-end data operations with Apache Airflow, Jenkins, and Databricks Workflows. Implemented data governance, security, and compliance practices and established robust testing frameworks.

Senior Big Data Engineer at Fresh Direct

December 1, 2020 - December 1, 2020

Managed a team of junior data engineers; designed and optimized scalable data pipelines using Databricks, Hadoop, and Spark. Developed ETL workflows with Delta Lake, Spark MLflow, and ADLS Gen2 for processing and analytics. Collaborated with data scientists and business teams to deliver actionable insights and ML-ready features. Established data governance and monitoring across Databricks and cloud environments; mentored engineers and promoted best practices in security, compliance, and performance.

Senior Big Data Engineer at Cap Consultancy

November 1, 2019 - November 1, 2019

Subject matter expert on Hadoop and Spark; designed and implemented real-time and batch data processing pipelines. Built and optimized Spark Streaming and batch jobs using PySpark, Spark SQL, Python, and Java; integrated Flume, Sqoop, Hive, and HBase for scalable ingestion and querying in HDFS. Implemented end-to-end ETL pipelines; migrated legacy data to cloud data lakes; enabled cross-cloud data integration using AWS EMR, Athena, Glue, as well as Azure Synapse and Databricks. Orchestrated workflows with Apache Airflow and monitored clusters with Ambari.

Data Engineer / Cloud Engineer at Newly Wish

January 1, 2018 - January 1, 2018

ETL development and data processing with loading into HDFS; designed data pipelines with PySpark, Kafka, Hive; automated UNIX shell tasks; migrated data from UNIX file systems to HDFS; implemented security and governance using IAM, KMS, and data masking; built CI/CD pipelines with Jenkins and Git; used AWS and Azure cloud platforms for scalable data processing.

Data Engineer at Startup Health

January 1, 2017 - January 1, 2017

Installed and configured Hadoop ecosystem; built Spark streaming and batch jobs; integrated Kafka for real-time processing; leveraged AWS EMR for scalable processing; performed data cleansing with Pandas/NumPy; implemented data quality checks and governance via AWS Glue Data Catalog and Apache Atlas; led stakeholder communications and delivered end-to-end data pipelines.