Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability. Proven experience in: End-to-end ETL/ELT pipeline development at scale Spark performance tuning and cost optimization Delta Lake–based ACID data architectures Data modelling, orchestration, and automation Modernizing legacy data pipelines to cloud-native platforms Near real-time data ingestion and processing Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.…Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability. Proven experience in: End-to-end ETL/ELT pipeline development at scale Spark performance tuning and cost optimization Delta Lake–based ACID data architectures Data modelling, orchestration, and automation Modernizing legacy data pipelines to cloud-native platforms Near real-time data ingestion and processing Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.

Vijay Palsingh





Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability. Proven experience in: End-to-end ETL/ELT pipeline development at scale Spark performance tuning and cost optimization Delta Lake–based ACID data architectures Data modelling, orchestration, and automation Modernizing legacy data pipelines to cloud-native platforms Near real-time data ingestion and processing Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.…Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability. Proven experience in: End-to-end ETL/ELT pipeline development at scale Spark performance tuning and cost optimization Delta Lake–based ACID data architectures Data modelling, orchestration, and automation Modernizing legacy data pipelines to cloud-native platforms Near real-time data ingestion and processing Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.

Available to hire

Data Engineer with 7+ years of experience designing, building, and operating scalable data platforms on Azure. Experienced in Azure, PySpark, Databricks, Airflow, SQL, Python, ADF, Synapse and Delta Lake, with a strong focus on data reliability, performance, and maintainability.

Proven experience in:
End-to-end ETL/ELT pipeline development at scale
Spark performance tuning and cost optimization
Delta Lake–based ACID data architectures
Data modelling, orchestration, and automation
Modernizing legacy data pipelines to cloud-native platforms
Near real-time data ingestion and processing

Interested in data engineering roles and contributing to data-driven organizations with complex data platforms.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Intermediate

Intermediate

Intermediate

Intermediate

Language

English

Fluent

Hindi

Fluent

Work Experience

Senior Data Engineer at StatusNeo

May 1, 2024 - Present

Created pipelines to ingest data from multiple sources into Data Bricks delta tables. Built end-to-end data pipelines from Kafka to Delta Lake, enabling reliable data delivery and real-time processing. Implemented bronze, silver, and gold layer data architecture, and created triggers for data parity checks across layers. Collaborated on ETL tasks, maintained data integrity, and verified pipeline stability. Optimized data pipelines with advanced ETL techniques and streaming data flows. Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.

Data Engineer at Tavant Technologies

January 1, 2021 - April 1, 2024

Developed AWS Lambda functions for file_name validation. Implemented Glue jobs for versatile data operations and Spark SQL for DB operations. Created data pipelines and pioneered Apache Airflow DAGs for Snowflake tasks. Engaged in transformations with Spark using Scala, improving Databricks job performance. Enhanced data pipeline performance through Spark transformations and Scala-based optimization.

Software Engineer at Skilrock Technologies

January 1, 2019 - December 1, 2020

Developed efficient REST APIs for comprehensive player management. Worked on data processing components and improved Databricks job performance with Spark and Scala.