Vijay Palsingh
Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure.
About
Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability.
Proven experience in:
End-to-end ETL/ELT pipeline development at scale
Spark performance tuning and cost optimization
Delta Lake–based ACID data architectures
Data modelling, orchestration, and automation
Modernizing legacy data pipelines to cloud-native platforms
Near real-time data ingestion and processing
Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.
- 7 years' experience
- Joined January 2026
Industry experience
- Software & Internet
More experts in Gurugram, India
Work experience
Created pipelines to ingest data from multiple sources into Data Bricks delta tables. Built end-to-end data pipelines from Kafka to Delta Lake, enabling reliable data delivery and real-time processing. Implemented bronze, silver, and gold layer data architecture, and created triggers for data parity checks across layers. Collaborated on ETL tasks, maintained data integrity, and verified pipeline stability. Optimized data pipelines with advanced ETL techniques and streaming data flows. Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.
Developed AWS Lambda functions for file_name validation. Implemented Glue jobs for versatile data operations and Spark SQL for DB operations. Created data pipelines and pioneered Apache Airflow DAGs for Snowflake tasks. Engaged in transformations with Spark using Scala, improving Databricks job performance. Enhanced data pipeline performance through Spark transformations and Scala-based optimization.
Developed efficient REST APIs for comprehensive player management. Worked on data processing components and improved Databricks job performance with Spark and Scala.
Education
Hire Vijay Palsingh today
Post a job and invite Vijay, or contact them directly. No hidden commission.





