Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Lead Data Engineer with 10 years’ experience designing, building and operating Microsoft-centric modern data platforms for commercial and not-for-profit organisations. Owns end-to-end delivery: metadata-driven lakehouse ingestion, governed dimensional/semantic models, and Power BI products used for decision-making. Deep Dynamics 365 integration experience and production AI delivery with Azure OpenAI under privacy-first, human-in-the-loop controls. Builds reusable, configuration-driven patterns that transfer across client environments, with a mathematics background and a track record of leading workshops and mentoring teams.…Lead Data Engineer with 10 years’ experience designing, building and operating Microsoft-centric modern data platforms for commercial and not-for-profit organisations. Owns end-to-end delivery: metadata-driven lakehouse ingestion, governed dimensional/semantic models, and Power BI products used for decision-making. Deep Dynamics 365 integration experience and production AI delivery with Azure OpenAI under privacy-first, human-in-the-loop controls. Builds reusable, configuration-driven patterns that transfer across client environments, with a mathematics background and a track record of leading workshops and mentoring teams.

Umar Ashraf

Data Engineer, Data Scientist, Programmer, +1





Lead Data Engineer with 10 years’ experience designing, building and operating Microsoft-centric modern data platforms for commercial and not-for-profit organisations. Owns end-to-end delivery: metadata-driven lakehouse ingestion, governed dimensional/semantic models, and Power BI products used for decision-making. Deep Dynamics 365 integration experience and production AI delivery with Azure OpenAI under privacy-first, human-in-the-loop controls. Builds reusable, configuration-driven patterns that transfer across client environments, with a mathematics background and a track record of leading workshops and mentoring teams.…Lead Data Engineer with 10 years’ experience designing, building and operating Microsoft-centric modern data platforms for commercial and not-for-profit organisations. Owns end-to-end delivery: metadata-driven lakehouse ingestion, governed dimensional/semantic models, and Power BI products used for decision-making. Deep Dynamics 365 integration experience and production AI delivery with Azure OpenAI under privacy-first, human-in-the-loop controls. Builds reusable, configuration-driven patterns that transfer across client environments, with a mathematics background and a track record of leading workshops and mentoring teams.

Available to hire

Lead Data Engineer with 10 years’ experience designing, building and operating Microsoft-centric modern data platforms for commercial and not-for-profit organisations. Owns end-to-end delivery: metadata-driven lakehouse ingestion, governed dimensional/semantic models, and Power BI products used for decision-making.

Deep Dynamics 365 integration experience and production AI delivery with Azure OpenAI under privacy-first, human-in-the-loop controls. Builds reusable, configuration-driven patterns that transfer across client environments, with a mathematics background and a track record of leading workshops and mentoring teams.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Beginner

Beginner

Language

Work Experience

Lead Data Engineer (Contract) at Energy One, Solihull — energy trading software vendor

May 1, 2026 - Present

Partner with product and trading stakeholders to define client-facing data and reporting products, translating operational datasets into reusable commercial analytics. Built portfolio composition and supplier allocation reporting over AMR smart-meter consumption data. Architected a metadata-driven medallion lakehouse on Azure Databricks and Synapse (PySpark, SQL, ADLS Gen2, Delta Lake, Unity Catalog) with incremental ingestion, watermarking, and configurable control/audit tables. Developed CDC/SCD2 Silver processing and Gold-layer facts/dimensions feeding Power BI semantic models. Designed code-first, configuration-driven Spark/Delta pipeline patterns to redeploy across customer environments, supporting daily hedging decision reporting from trading logic.

Lead Data Engineer (Contract) at Oakland, Leeds — consultancy engagement (NDA signed)

January 1, 2026 - May 31, 2026

Led the AI workstream: a production LLM pipeline (Azure OpenAI, Azure AI Foundry) generating classifications, summaries, prioritisation against a defined framework, timelines and draft customer communications. Implemented privacy-first development using synthetic datasets. Built a human-in-the-loop governance layer in Power Apps validating every AI output before release. Designed and built Azure Databricks pipelines across Bronze/Silver/Gold with incremental ingestion and SCD2 history for full auditability. Developed entity matching and bridge logic connecting related records across disparate systems; delivered curated dimensional models and Power BI reporting for validated AI-assisted operational reporting.

Lead Financial Data Engineer (Contract) at The NEC, Birmingham

July 1, 2025 - December 31, 2025

Integrated Dynamics 365 Finance & Operations, Dynamics CRM and legacy sources into a unified finance lakehouse and dimensional model using the medallion pattern. Supported the Synapse-to-Fabric migration of finance workloads. Developed Customer Engagement and F&O Power BI semantic model for reconciliation and drill-down reporting. Implemented incremental loading and validation logic to protect the accuracy of financial measures.

Lead Data Engineer (Contract) at BioPhorum, London

June 1, 2023 - June 30, 2025

Led an end-to-end ground-up build of a cloud-native enterprise data platform (Synapse, Databricks, Fabric) for a global membership organisation. Integrated Dynamics 365 CRM, NetSuite, BambooHR, SharePoint and APIs into a governed medallion architecture. Built campaign and engagement analytics including UTM-to-session-to-order attribution, email analytics combined with SharePoint engagement logs into campaign-to-site funnels, and cohort lifetime-value views. Automated weekly ROI and retention dashboards in Power BI and produced decision memos driving budget reallocation. Designed data quality checkpoints and stakeholder sign-off workflows. Proposed and executed a cloud migration strategy (removing on-prem gateway dependency) and introduced CDC for near-real-time data movement with full documentation and version control.

Lead Data Engineer (Contract) at SK:N Clinics, Coleshill

March 1, 2022 - June 30, 2023

Delivered an end-to-end platform migration within a £500k system overhaul, moving on-prem SQL Server, MariaDB and Google Analytics workloads to a cloud-native lakehouse (Synapse, Databricks). Rebuilt legacy SSIS workflows/business logic in Synapse and Spark, simplifying complex code and reducing run times. Built and governed ingestion/reporting across finance, operations, call centre and marketing domains. Built, managed and mentored a team of seven, defining delivery workflows and coaching Power BI and DAX best practice; set usage and governance standards. Acted as the bridge between business and technical teams, translating needs into scalable solutions.

Data Engineer / Data Scientist (Permanent) at RAC, Walsall

February 1, 2021 - March 31, 2022

Reduced daily average forecast error from 7% to 3% on operational demand forecasting, improving cost efficiency and service quality. Developed and validated Python time-series/ML models (Prophet, ARIMA, XGBoost, neural networks) with model validation documentation. Conducted statistical validation of externally produced models and roster builds to prevent a potential £500,000 loss. Led and mentored two data analysts; developed Power BI and Tableau reporting including a £40,000 cost-saving planning report.

Data Analyst / Data Engineer (Permanent) at DeliverBI, Remote

January 1, 2016 - February 28, 2021

Built production pipelines on Google Cloud Platform ingesting line-of-business applications, APIs and files into Cloud Storage and BigQuery with parameterised incremental loads and data quality checks orchestrated through Apache Airflow/Cloud Composer. Modelled star-schema curated datasets in BigQuery and delivered Power BI semantic models, executive dashboards and Excel reporting with row-level security and refresh governance.