Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Hi, I’m Sahil Gupta. I’m a results-driven senior software and data engineer with about 12 years of experience designing and implementing modern data architectures, including Data Lakes, Lakehouses, and Medallion models. I specialize in using Databricks, Azure, and Palantir Foundry, with hands-on expertise in Python, SQL, Apache Spark, and Delta Lake to build scalable, high-performance ETL pipelines. I also leverage Power BI and Tableau for analytics and visualization, ensuring clean, structured data that informs decision-making. I’m skilled in streaming and batch processing, data quality governance, and DevOps automation with Airflow and Jenkins, plus containerization with Docker and Kubernetes. I hold Azure DP-203 and Databricks Data Engineer Associate certifications and have experience integrating NoSQL (MarkLogic, MongoDB) with relational databases in hybrid ecosystems. I’m passionate about automation, efficiency, and collaboration within Agile teams.…Hi, I’m Sahil Gupta. I’m a results-driven senior software and data engineer with about 12 years of experience designing and implementing modern data architectures, including Data Lakes, Lakehouses, and Medallion models. I specialize in using Databricks, Azure, and Palantir Foundry, with hands-on expertise in Python, SQL, Apache Spark, and Delta Lake to build scalable, high-performance ETL pipelines. I also leverage Power BI and Tableau for analytics and visualization, ensuring clean, structured data that informs decision-making. I’m skilled in streaming and batch processing, data quality governance, and DevOps automation with Airflow and Jenkins, plus containerization with Docker and Kubernetes. I hold Azure DP-203 and Databricks Data Engineer Associate certifications and have experience integrating NoSQL (MarkLogic, MongoDB) with relational databases in hybrid ecosystems. I’m passionate about automation, efficiency, and collaboration within Agile teams.

Sahil Gupta

PRO

Full Stack Developer, Web Developer, Data Scientist, +2





Hi, I’m Sahil Gupta. I’m a results-driven senior software and data engineer with about 12 years of experience designing and implementing modern data architectures, including Data Lakes, Lakehouses, and Medallion models. I specialize in using Databricks, Azure, and Palantir Foundry, with hands-on expertise in Python, SQL, Apache Spark, and Delta Lake to build scalable, high-performance ETL pipelines. I also leverage Power BI and Tableau for analytics and visualization, ensuring clean, structured data that informs decision-making. I’m skilled in streaming and batch processing, data quality governance, and DevOps automation with Airflow and Jenkins, plus containerization with Docker and Kubernetes. I hold Azure DP-203 and Databricks Data Engineer Associate certifications and have experience integrating NoSQL (MarkLogic, MongoDB) with relational databases in hybrid ecosystems. I’m passionate about automation, efficiency, and collaboration within Agile teams.…Hi, I’m Sahil Gupta. I’m a results-driven senior software and data engineer with about 12 years of experience designing and implementing modern data architectures, including Data Lakes, Lakehouses, and Medallion models. I specialize in using Databricks, Azure, and Palantir Foundry, with hands-on expertise in Python, SQL, Apache Spark, and Delta Lake to build scalable, high-performance ETL pipelines. I also leverage Power BI and Tableau for analytics and visualization, ensuring clean, structured data that informs decision-making. I’m skilled in streaming and batch processing, data quality governance, and DevOps automation with Airflow and Jenkins, plus containerization with Docker and Kubernetes. I hold Azure DP-203 and Databricks Data Engineer Associate certifications and have experience integrating NoSQL (MarkLogic, MongoDB) with relational databases in hybrid ecosystems. I’m passionate about automation, efficiency, and collaboration within Agile teams.

Available to hire

Zurich, Switzerland

Hi, I’m Sahil Gupta. I’m a results-driven senior software and data engineer with about 12 years of experience designing and implementing modern data architectures, including Data Lakes, Lakehouses, and Medallion models. I specialize in using Databricks, Azure, and Palantir Foundry, with hands-on expertise in Python, SQL, Apache Spark, and Delta Lake to build scalable, high-performance ETL pipelines. I also leverage Power BI and Tableau for analytics and visualization, ensuring clean, structured data that informs decision-making. I’m skilled in streaming and batch processing, data quality governance, and DevOps automation with Airflow and Jenkins, plus containerization with Docker and Kubernetes. I hold Azure DP-203 and Databricks Data Engineer Associate certifications and have experience integrating NoSQL (MarkLogic, MongoDB) with relational databases in hybrid ecosystems. I’m passionate about automation, efficiency, and collaboration within Agile teams.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Language

English

Advanced

Work Experience

Senior Data Engineer at Wipro Limited

September 23, 2019 - October 11, 2025

Designed and developed end-to-end data pipelines in Databricks, Azure Data Factory, and Palantir Foundry to ingest and transform large-scale financial data for analytics and compliance. Implemented Medallion architecture (Bronze–Silver–Gold) on Databricks and Delta Lake to improve scalability, query performance, and downstream reporting. Built automated ETL/ELT frameworks using Python, PySpark, and SQL for batch and real-time streaming workloads. Collaborated with data consumers to define analytical requirements and deliver BI-ready datasets visualized through Power BI and Foundry dashboards. Designed data models and lineage tracking, applying governance and quality checks for auditability. Supported integration of Airflow and Jenkins-based CI/CD pipelines for deployments to Azure. Leveraged Docker and Kubernetes (via OpenShift) for containerized data applications and workload orchestration. Mentored junior engineers on Spark optimization and cloud migration strategies.