Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am Dilip Thallam Sridhar, a Senior Big Data Engineer with 20+ years of hands-on experience delivering scalable data platforms across on-prem and cloud environments, including Azure, AWS, and GCP. I specialize in Azure Data Factory, ADLS Gen2, Databricks, Spark, Python, Kafka, and data governance frameworks to enable reliable, auditable analytics. I have led end-to-end data pipelines (bronze-silver-gold, Delta Lake) with strong emphasis on data quality, schema evolution, and security using Unity Catalog and Purview. I thrive in fast-paced teams across Banking, Payments, Travel, and Manufacturing, and enjoy building robust CI/CD pipelines, testing strategies, and cross-team collaboration.…I am Dilip Thallam Sridhar, a Senior Big Data Engineer with 20+ years of hands-on experience delivering scalable data platforms across on-prem and cloud environments, including Azure, AWS, and GCP. I specialize in Azure Data Factory, ADLS Gen2, Databricks, Spark, Python, Kafka, and data governance frameworks to enable reliable, auditable analytics. I have led end-to-end data pipelines (bronze-silver-gold, Delta Lake) with strong emphasis on data quality, schema evolution, and security using Unity Catalog and Purview. I thrive in fast-paced teams across Banking, Payments, Travel, and Manufacturing, and enjoy building robust CI/CD pipelines, testing strategies, and cross-team collaboration.

Dilip Thallam Sridhar

Cloud Developer, Data Analyst, DevOps Developer, +3





I am Dilip Thallam Sridhar, a Senior Big Data Engineer with 20+ years of hands-on experience delivering scalable data platforms across on-prem and cloud environments, including Azure, AWS, and GCP. I specialize in Azure Data Factory, ADLS Gen2, Databricks, Spark, Python, Kafka, and data governance frameworks to enable reliable, auditable analytics. I have led end-to-end data pipelines (bronze-silver-gold, Delta Lake) with strong emphasis on data quality, schema evolution, and security using Unity Catalog and Purview. I thrive in fast-paced teams across Banking, Payments, Travel, and Manufacturing, and enjoy building robust CI/CD pipelines, testing strategies, and cross-team collaboration.…I am Dilip Thallam Sridhar, a Senior Big Data Engineer with 20+ years of hands-on experience delivering scalable data platforms across on-prem and cloud environments, including Azure, AWS, and GCP. I specialize in Azure Data Factory, ADLS Gen2, Databricks, Spark, Python, Kafka, and data governance frameworks to enable reliable, auditable analytics. I have led end-to-end data pipelines (bronze-silver-gold, Delta Lake) with strong emphasis on data quality, schema evolution, and security using Unity Catalog and Purview. I thrive in fast-paced teams across Banking, Payments, Travel, and Manufacturing, and enjoy building robust CI/CD pipelines, testing strategies, and cross-team collaboration.

Available to hire

I am Dilip Thallam Sridhar, a Senior Big Data Engineer with 20+ years of hands-on experience delivering scalable data platforms across on-prem and cloud environments, including Azure, AWS, and GCP. I specialize in Azure Data Factory, ADLS Gen2, Databricks, Spark, Python, Kafka, and data governance frameworks to enable reliable, auditable analytics.

I have led end-to-end data pipelines (bronze-silver-gold, Delta Lake) with strong emphasis on data quality, schema evolution, and security using Unity Catalog and Purview. I thrive in fast-paced teams across Banking, Payments, Travel, and Manufacturing, and enjoy building robust CI/CD pipelines, testing strategies, and cross-team collaboration.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Senior Data Engineer at CQC

March 1, 2025 - March 1, 2025

Led big data ingestion and transformation pipelines on Azure Databricks, enabling data sharing, governance, and reporting to Health Inspectors via Power BI. Implemented data access controls using Unity Catalog, data lineage, and data quality rules; supported Delta sharing and Purview/Data governance.

Data Engineer (Common Data Service Platform) at OSB

November 1, 2023 - November 1, 2023

Developed data ingestion and transformation pipelines on Azure Databricks; migrated input sources to Spark SQL, and implemented data governance with Purview and Unity Catalog across environments.

Data Engineer (RRP Migration) at HSBC London

April 1, 2023 - April 1, 2023

Implemented end-to-end data platform on Azure and on‑prem for RRP migration; used Spark/PySpark, Kafka, Data Factory, Delta Lake, ADLS Gen2, and Power BI for data processing and visualization.

Data Engineer at Megafone / Dyancommerce

March 1, 2021 - March 1, 2021

Ingested and transformed bundle product offers data using Kafka, Nifi, Spark/Databricks on AWS; built end-to-end data platform including Lambda, Glue, S3, and analytics tools.

Principal Data Engineer at NatWest / RBS

December 1, 2020 - December 1, 2020

Developed end-to-end enterprise data platform on AWS, including Lambda, Glue, SQS, S3, DynamoDB, and Kafka-based streaming; built testing with Pytest and managed CI/CD pipelines.

Senior Data Engineer at Rolls-Royce (Data Room)

June 1, 2020 - June 1, 2020

Led enterprise data platform development on Azure with open-source tools for real-time analytics, data ingestion, cleansing, processing, and visualization; implemented data governance and secure data access.

Senior Java Developer at Ladbrokes-Coral

December 1, 2017 - December 1, 2017

Integrated data fabric platforms using Java, Kafka, AWS, Docker, and Terraform to consolidate Ladbrokes and Coral platforms; built components for data integration.

Senior Java Developer at HSBC (Regulatory & Compliance Programme)

June 1, 2017 - June 1, 2017

Contributed to regulatory and compliance rollout across countries; developed low-latency, scalable services with Java, Spring, OSB, Drools, and REST APIs; supported test-driven development.

Senior Java Developer at Goldman Sachs (Hydra)

March 1, 2016 - March 1, 2016

Worked on low-latency, high-volume trading modules; implemented test-driven development, built with Java/J2EE, Spring, ES, and Drools; contributed to Alpaca-based testing framework and regression suites.

Senior Java Developer at Travel for Greater Manchester (TfGM)

February 1, 2015 - February 1, 2015

Developed mobile payments services using Java and Scala with SOA, OSB; built payment service modules with AWS integration; agile XP practices.

Senior Java Developer at Vocalink

September 1, 2014 - September 1, 2014

Developed low-latency payment solutions; built modules for speed and reliability; implemented REST/SOAP services, and used Elasticsearch for metrics reporting; led Scrum activities.

Senior SOA Developer at Prudential (PAAM)

March 1, 2013 - March 1, 2013

Developed pensions & annuities modular Java applications on the OSGi platform; Spring Camel integration; JAXP/XSLT transformations; unit/integration testing.

Senior Java Developer at JP Morgan Chase - iPay & IACH

January 1, 2012 - January 1, 2012

Developed Payments Clearing system; multi-currency module; JMS connectivity; parallel processing; implemented test-driven development with JUnit.

Senior Java Developer at UBS - Operation Risk Inventory (ORI)

December 1, 2010 - December 1, 2010

Implemented risk management workflows; multi-user online web-based tool; Struts2, Spring, Hibernate; concurrency handling; performance optimization.

Java Developer at ITN Network - AiRes

July 1, 2009 - July 1, 2009

Maintained and developed passenger reservation system components; Struts, Spring/XML; performance tuning and data integration.

Education

Bachelor of Technology (Electrical & Electronics) at Jawaharlal Nehru Technological University, Andhra Pradesh, INDIA

January 11, 2030 - November 1, 2025

Qualifications

Add your qualifications or awards here.

Industry Experience

Financial Services, Software & Internet, Professional Services, Manufacturing, Travel & Hospitality, Media & Entertainment, Telecommunications, Government, Education