Available to hire
Azure Data Engineer with 4 years of experience designing and implementing end-to-end data solutions using Azure (ADF, Synapse), Databricks, Fabric, and Delta Lake. Skilled in building automated, metadata-driven ETL/ELT pipelines, ensuring reliable data ingestion and transformation, and delivering governed, auditable datasets for analytics and reporting.
Strong in Python/PySpark, SQL performance optimization, streaming and incremental processing, and real-time monitoring with custom logging/error-handling frameworks. Adept at data governance (Purview, Unity Catalog), IAM/RBAC, and stakeholder-friendly BI delivery through Power BI and Tableau dashboards to support faster, data-driven decisions.
Skills
Language
English
Advanced
Work Experience
Analytical Data Engineer at SSP (Contract)
September 2, 2024 - April 24, 2026Conducted stakeholder interviews and requirement workshops with clinical and CRM teams to translate business rules into actionable ETL pipelines, improving delivery timelines and reporting accuracy by 20%. Designed Dataverse integration pipelines to consolidate hospital and CRM datasets, reducing manual reconciliation of patient records by 40% while ensuring consistent master data. Built ADF/Fabric orchestration workflows for multi-stage ETL with scheduling and automated retry logic to meet strict clinical SLAs. Implemented Delta Lake tables with schema enforcement for structured and semi-structured clinical data. Developed Python scripts for GDPR-compliant data anonymization of sensitive patient information. Created SQL stored procedures in Azure SQL DB for complex aggregations and transformations, reducing query runtime by 25%. Configured Unity Catalog for fine-grained governance and access control (IAM/RBAC) to improve security, compliance tracking, and audit readiness. Built increm
Data Engineer at TCS (Dupont)
February 21, 2022 - December 9, 2022Partnered with product and marketing teams to gather requirements for multi-channel e-commerce reporting and translated them into ETL workflows across Azure, AWS S3, and RedShift, improving pipeline efficiency by 25%. Built real-time transaction pipelines using Databricks and Python to process millions of customer events from CosmosDB and S3, reducing ingestion latency by 30% while maintaining reliability and scalability. Leveraged PySpark for streaming transformations on clickstream and transactional data, optimizing distributed processing and reducing Databricks compute cost by 20%. Automated Python-based data validation for incremental loads, detecting anomalies and reducing manual monitoring effort by 35% across heterogeneous sources. Implemented metadata-driven pipelines using Delta Lake, ADLS, and Azure Purview to track lineage and enforce robust governance in hybrid environments. Built Power BI dashboards combining CRM, RedShift, and S3 datasets for near real-time campaign and c
Data Engineer at TCS (Boeing)
August 16, 2021 - February 18, 2022Led requirement gathering sessions to understand legacy ETL processes and map KPIs for migration to Azure-based workflows and reporting systems. Implemented a project migrating SSIS pipelines to Azure using Databricks and ADF for automated multi-source SAP datasets and historical data processing. Developed Python scripts for automated testing and anomaly detection to ensure migrated SAP ETL workflows produced consistent results across datasets and transformations. Created Power BI dashboards consolidating SAP BO reports with Azure SQL datasets for real-time finance and operations insights. Designed hybrid data warehouse and data lake architecture for SAP and Azure SQL integration, improving query performance by 35% for financial analytics. Implemented RBAC/IAM policies to protect sensitive SAP datasets and meet governance and audit requirements. Migrated legacy SSIS workflows into Databricks notebooks and ADF pipelines, reducing manual intervention and enabling incremental processing.
MSBI Developer at TCS (HoneyWell)
November 16, 2020 - August 13, 2021Collaborated with finance and operations teams to gather requirements for enterprise reporting and translated KPIs into structured ETL workflows and automated dashboards. Designed new Power BI and Tableau dashboards integrating SAP and SQL datasets for cross-functional teams to monitor KPIs with automated visual analytics. Used Alteryx for data preparation and transformation, cleaning and aggregating large transactional datasets to ensure accurate operational and financial reporting outputs. Developed Python scripts to automate SSIS ETL testing, validation, and anomaly detection, reducing manual reconciliation by 40% across reports and datasets. Created interactive Tableau and Power BI dashboards with drill-down capabilities for sales, finance, and operational KPI monitoring. Designed data warehouse and data lake structures using Delta Lake principles to ensure high availability and optimized query performance. Migrated legacy SSIS and SSRS reports to modern dashboards in Power BI and
Education
Qualifications
Master’s in Computer Science
January 11, 2030 - August 20, 2026Bachelor’s in Computer Science
January 11, 2030 - August 20, 2026Azure Fundamentals AZ-900
January 11, 2030 - August 20, 2026Databricks Data Engineer Associate
January 11, 2030 - August 20, 2026Master’s in Computer Science
January 11, 2030 - August 20, 2026Bachelor’s in Computer Science
January 11, 2030 - August 20, 2026Microsoft Certified: Azure Fundamentals (AZ-900)
January 11, 2030 - August 20, 2026Databricks Certified: Data Engineer Associate
January 11, 2030 - August 20, 2026Industry Experience
Healthcare, Financial Services, Professional Services, Software & Internet, Transportation & Logistics
Skills
Hire a Data Engineer
We have the best data engineer experts on Twine. Hire a data engineer in London today.