Senior Data Engineer with 10+ years of experience designing and delivering scalable cloud data platforms across enterprise data analytics, reporting, and compliance, with deep exposure to Banking and Financial Services. Hands-on expertise across Azure Data Factory, Azure Databricks, PySpark/Spark SQL, Delta Lake, and Snowflake—building auditable ETL/ELT pipelines with incremental processing, MERGE-based upserts, SCD Type 1 & 2, and schema evolution.
Proven strength in Spark performance tuning, cost optimization, and implementing data quality/reconciliation/governance frameworks for production reporting. Experienced with CI/CD using Git and Azure DevOps, Infrastructure as Code (Terraform), and workflow orchestration via ADF triggers and Databricks Jobs, providing L3 production support with RCA and continuous improvements.
Experience Level
Language
Work Experience
Education
Qualifications
Industry Experience
Experience Level
Hire a Data Engineer
We have the best data engineer experts on Twine. Hire a data engineer today.