VP

Vijay Palsingh

Available to hire

Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure.

About

Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability.

Proven experience in:
End-to-end ETL/ELT pipeline development at scale
Spark performance tuning and cost optimization
Delta Lake–based ACID data architectures
Data modelling, orchestration, and automation
Modernizing legacy data pipelines to cloud-native platforms
Near real-time data ingestion and processing

Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.

  • 7 years' experience
  • Joined January 2026

Languages

  • EnglishFluent
  • HindiFluent

Industry experience

  • Software & Internet

Work experience

Senior Data Engineer · StatusNeoMay 2024 – Present · 2 yrs 7 mos

Created pipelines to ingest data from multiple sources into Data Bricks delta tables. Built end-to-end data pipelines from Kafka to Delta Lake, enabling reliable data delivery and real-time processing. Implemented bronze, silver, and gold layer data architecture, and created triggers for data parity checks across layers. Collaborated on ETL tasks, maintained data integrity, and verified pipeline stability. Optimized data pipelines with advanced ETL techniques and streaming data flows. Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.

Data Engineer · Tavant TechnologiesJan 2021 – Apr 2024 · 3 yrs 4 mos

Developed AWS Lambda functions for file_name validation. Implemented Glue jobs for versatile data operations and Spark SQL for DB operations. Created data pipelines and pioneered Apache Airflow DAGs for Snowflake tasks. Engaged in transformations with Spark using Scala, improving Databricks job performance. Enhanced data pipeline performance through Spark transformations and Scala-based optimization.

Software Engineer · Skilrock TechnologiesJan 2019 – Dec 2020 · 2 yrs

Developed efficient REST APIs for comprehensive player management. Worked on data processing components and improved Databricks job performance with Spark and Scala.

Education

Bachelor of Technology (B.Tech) - Computer Science and Engineering · GL Bajaj Institute Of Technology and Management2015 – 2019

Hire Vijay Palsingh today

Post a job and invite Vijay, or contact them directly. No hidden commission.

Post a job