Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I'm an accomplished Principal Data Engineer with over 26 years of experience in delivering enterprise-scale data platforms and leading global teams. I specialize in Azure-based architectures, real-time analytics, and AI/ML integration. I have a strong passion for building scalable, cloud-native solutions that transform businesses. I enjoy fostering a culture of continuous learning and collaboration, empowering my team to grow and consistently deliver high performance. My experience spans financial data collaboration with actuaries, complex risk metric calculations, and delivering compliant reporting that supports insightful decision-making.…I'm an accomplished Principal Data Engineer with over 26 years of experience in delivering enterprise-scale data platforms and leading global teams. I specialize in Azure-based architectures, real-time analytics, and AI/ML integration. I have a strong passion for building scalable, cloud-native solutions that transform businesses. I enjoy fostering a culture of continuous learning and collaboration, empowering my team to grow and consistently deliver high performance. My experience spans financial data collaboration with actuaries, complex risk metric calculations, and delivering compliant reporting that supports insightful decision-making.

Keith Bailey

Database Developer, AI Engineer, Cloud Developer, +3





I'm an accomplished Principal Data Engineer with over 26 years of experience in delivering enterprise-scale data platforms and leading global teams. I specialize in Azure-based architectures, real-time analytics, and AI/ML integration. I have a strong passion for building scalable, cloud-native solutions that transform businesses. I enjoy fostering a culture of continuous learning and collaboration, empowering my team to grow and consistently deliver high performance. My experience spans financial data collaboration with actuaries, complex risk metric calculations, and delivering compliant reporting that supports insightful decision-making.…I'm an accomplished Principal Data Engineer with over 26 years of experience in delivering enterprise-scale data platforms and leading global teams. I specialize in Azure-based architectures, real-time analytics, and AI/ML integration. I have a strong passion for building scalable, cloud-native solutions that transform businesses. I enjoy fostering a culture of continuous learning and collaboration, empowering my team to grow and consistently deliver high performance. My experience spans financial data collaboration with actuaries, complex risk metric calculations, and delivering compliant reporting that supports insightful decision-making.

Available to hire

I’m an accomplished Principal Data Engineer with over 26 years of experience in delivering enterprise-scale data platforms and leading global teams. I specialize in Azure-based architectures, real-time analytics, and AI/ML integration. I have a strong passion for building scalable, cloud-native solutions that transform businesses.

I enjoy fostering a culture of continuous learning and collaboration, empowering my team to grow and consistently deliver high performance. My experience spans financial data collaboration with actuaries, complex risk metric calculations, and delivering compliant reporting that supports insightful decision-making.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Language

English

Fluent

Work Experience

Principal Data Engineering Lead at The Pensions Regulator

May 1, 2023 - Present

Led an 8-member data engineering team working in hybrid and remote models. Developed and managed an enterprise-scale data platform leveraging a Lakehouse architecture powered by Azure cloud technologies such as Azure Data Factory, Databricks, Synapse, CosmosDB, Azure SQL, ADLS, APIM, and Azure Analysis Services, ensuring scalability, performance, and integration. Implemented complex data models including Slowly Changing Dimensions and star/snowflake schemas for historical data analysis. Spearheaded the SDLC using Azure DevOps with Release Flow methodology to streamline source control and CI/CD pipelines. Architected and optimized high-performance ETL pipelines utilizing Databricks, Delta Live Tables, Azure Data Factory, Logic Apps, Power Platform Flows, REST APIs, and event-driven microservices. Collaborated with the Enterprise Architecture Board to integrate AI/ML strategies including Azure OpenAI and Machine Learning Studio for advanced analytics. Worked with actuaries to develop and

Global Data Engineering Manager

May 1, 2023 - July 25, 2025

Led a global team across UK, USA, and Australia delivering seamless data integration services for 77 companies. Designed and implemented system-to-system, partner, and API integrations using Azure Data Stack and APIM including .NET C# Web APIs with Entity Framework. Engineered ingestion pipelines for diverse data sources such as Salesforce, Azure SQL, SharePoint, XML, and Parquet. Optimized Azure Data Factory and Jitterbit frameworks reducing operational downtime and enhancing ETL pipeline reliability. Directed Agile sprints and backlog management in Azure DevOps to achieve strategic data initiatives aligned with business goals. Delivered a scalable framework-based data platform supporting complex integrations and digital platform delivery. Streamlined cross-entity data sharing improving efficiency across international markets. Partnered with global finance to design near real-time data solutions providing insights into financial performance that adhered to US GAAP standards.

Integration & Engineering Manager

February 1, 2022 - July 25, 2025

Provided advanced data technology services to clients across UK, Netherlands, USA, and Australia. Managed a team of 7 engineers in the UK, Portugal and India. Led design and migration of on-premises SQL Server Data Warehouse to Azure Data Stack ensuring scalability and performance. Developed partner integrations improving customer efficiency and ensured adherence to SLA compliance. Directed migration of multiple enterprise-scale database systems from on-premises to cloud. Led development of multi-entity financial reporting capabilities for complex global organizational structures enabling consolidated insights and planning.

Business Intelligence Manager

March 1, 2013 - July 25, 2025

Directed a BI team of 5 including developers, DBAs, and data engineers. Transitioned in-house BI operations offshore to Delhi, India, driving cost savings and scalability. Enhanced reporting and analytics capabilities implementing SAP Lumira and Power BI enabling insightful data visualizations and business intelligence.

Database Developer

July 1, 2010 - July 25, 2025

Duties and technology stack details available on request.

Database Administrator (Ingress 2)

May 1, 2004 - July 25, 2025

Duties and technology stack details available on request.

Trainee Database Administrator (Ingress 2)

February 1, 2002 - July 25, 2025

Duties and technology stack details available on request.