Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I'm an experienced Azure Data Engineer with 12+ years delivering scalable data platforms across financial services, banking, and insurance. I focus on designing and implementing modern data engineering and analytics solutions using Microsoft Azure, Databricks, and BI tooling to solve real business problems and drive value. I thrive in collaborative environments, engage with stakeholders, and mentor junior teammates. My strength lies in building end-to-end data platforms (Bronze-Silver-Gold/Medallion architecture) with a strong emphasis on PySpark, SQL, Delta Lake, data governance, and performance optimization to support robust reporting and decision-making.…I'm an experienced Azure Data Engineer with 12+ years delivering scalable data platforms across financial services, banking, and insurance. I focus on designing and implementing modern data engineering and analytics solutions using Microsoft Azure, Databricks, and BI tooling to solve real business problems and drive value. I thrive in collaborative environments, engage with stakeholders, and mentor junior teammates. My strength lies in building end-to-end data platforms (Bronze-Silver-Gold/Medallion architecture) with a strong emphasis on PySpark, SQL, Delta Lake, data governance, and performance optimization to support robust reporting and decision-making.

Ramarao Daggubati

Data Analyst, Cloud Developer, Data Visualizer





I'm an experienced Azure Data Engineer with 12+ years delivering scalable data platforms across financial services, banking, and insurance. I focus on designing and implementing modern data engineering and analytics solutions using Microsoft Azure, Databricks, and BI tooling to solve real business problems and drive value. I thrive in collaborative environments, engage with stakeholders, and mentor junior teammates. My strength lies in building end-to-end data platforms (Bronze-Silver-Gold/Medallion architecture) with a strong emphasis on PySpark, SQL, Delta Lake, data governance, and performance optimization to support robust reporting and decision-making.…I'm an experienced Azure Data Engineer with 12+ years delivering scalable data platforms across financial services, banking, and insurance. I focus on designing and implementing modern data engineering and analytics solutions using Microsoft Azure, Databricks, and BI tooling to solve real business problems and drive value. I thrive in collaborative environments, engage with stakeholders, and mentor junior teammates. My strength lies in building end-to-end data platforms (Bronze-Silver-Gold/Medallion architecture) with a strong emphasis on PySpark, SQL, Delta Lake, data governance, and performance optimization to support robust reporting and decision-making.

Available to hire

I’m an experienced Azure Data Engineer with 12+ years delivering scalable data platforms across financial services, banking, and insurance. I focus on designing and implementing modern data engineering and analytics solutions using Microsoft Azure, Databricks, and BI tooling to solve real business problems and drive value.

I thrive in collaborative environments, engage with stakeholders, and mentor junior teammates. My strength lies in building end-to-end data platforms (Bronze-Silver-Gold/Medallion architecture) with a strong emphasis on PySpark, SQL, Delta Lake, data governance, and performance optimization to support robust reporting and decision-making.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Azure Databricks Data Engineer (Contract) at Metro Bank, London

July 1, 2025 - May 1, 2026

Designed and developed data ingestion and transformation pipelines for Retail Loans and Lending data using Azure Data Factory, Azure Databricks, and PySpark notebooks to process large volumes of loan application, customer, repayment, and delinquency data. Implemented Delta Lake architecture to support ACID compliant data processing and efficient handling of incremental loan data using Watermark and Merge techniques. Created pipelines for loan origination, servicing, repayments, arrears, and reporting datasets. Implemented Unity Catalog for centralized governance, access control, data lineage, auditing, and secure asset management. Optimized Spark workloads with partitioning, caching, and performance tuning, reducing processing times. Collaborated with business analysts and lending teams to translate requirements into data solutions. Adopted source control with Azure DevOps Repos and Git.

Senior Data Engineer (Contract) at PoloWorks (A Lloyd’s market insurance), London

September 1, 2024 - June 1, 2025

Built an end-to-end data platform using Microsoft Fabric with Onelake and Lakehouse architecture for Lloyd's Managing Agent across multiple syndicates. Implemented data ingestion pipelines (Fabric Pipelines) from DXC Assure Policy Admin, APIs, and SQL sources into Lakehouse Bronze. Developed PySpark notebooks for transformation and aggregation to curated datasets for analytics. Applied RBAC security, partitioning, and optimized Spark transformations. Modeled data using Lakehouse SQL endpoints and created semantic models for reporting. Implemented CI/CD with Azure DevOps, Git, and Fabric deployment pipelines; engaged with underwriting, finance, and reporting stakeholders to ensure delivery.

Azure Data Engineer (Contract) at Skipton Building Society, UK

July 1, 2023 - May 1, 2024

Designed and implemented an Azure Databricks solution to consolidate mortgage servicing data from multiple source systems. Built 10+ data pipelines for ingestion and transformation using ADF, PySpark, and SQL. Implemented Bronze-Silver-Gold medallion architecture, Databricks workspaces, and Unity Catalog for governance and access control. Automated deployments via CI/CD pipelines and integrated source control. Engaged with data owners to gather requirements and validated Bronze, Silver, and Gold layer data.

Azure Data Engineer (Contract) at Computershare, UK

January 1, 2022 - April 1, 2023

Supported data warehouse and reporting solutions for mortgage servicing portfolios. Developed ADF pipelines to ingest mortgage data into ADLS, implemented incremental loading with watermarking, and built reusable datasets. Designed dimensional models (FactMortgageAccountSnapshot, FactMortgagePayments, etc.) and performed ELT using Synapse SQL to deliver curated reporting layers. Implemented Slowly Changing Dimensions (SCD Type 2) for historical tracking.

BI Developer (Contract) at Sainsbury’s Bank, London

November 1, 2020 - December 1, 2021

Designed and developed data ingestion pipelines to centralise data from Travel Money and Travel Insurance applications using SQL, SSIS, and Power BI. Built multi-layer data warehouse architecture to support reporting, migrated SSRS and Excel-based reports to Power BI, and implemented Row-Level Security for multiple user groups. Acted as a liaison between stakeholders and delivery teams, delivering solutions in an Agile framework.

BI Developer / Power BI Developer (Contract) at Post Office, London

October 1, 2018 - September 1, 2020

Sourced data from Horizon and external sources for daily transactions from 11,000 branches. Developed ETL pipelines and dashboards in Power BI, designed and implemented a central data warehouse, and migrated reporting from SSRS/Excel to Power BI. Implemented Row-Level Security and managed multiple workspaces for different user groups. Delivered demos and POCs to stakeholders in an Agile setting.

Earlier Roles

April 1, 2006 - July 1, 2018

ERP Data Migration Analyst (HS2, Birmingham); BI Developer (LineView Solutions, Birmingham); BI Developer (ERS Insurance, London); SQL BI Consultant (Invatech Health, Bristol); SQL BI Consultant (Iress Financial Services, Cheltenham); Data Migration Analyst (Hornbuckle, Leeds); BI Developer (Veolia, Birmingham); BI Developer (Lebara, London); Siebel CRM Developer (TCS, India). Designed and supported enterprise Data Warehouses and BI solutions using SQL Server, SSIS/SSRS/SSAS and Power BI, built dimensional models, optimized SQL/ETL, and collaborated with stakeholders. Migrated data from SAP to Oracle Fusion (HS2).