Available to hire
Data engineer with 4 years hands-on experience designing and implementing scalable cloud-based ETL pipelines using Azure Data Factory, DataBricks, Synapse, and Fabric. Proficient in Python and PySpark automation for big data processing workflows, improving data governance, security, and delivery of actionable insights.
Results-driven professional experienced in metadata-driven pipeline design, Delta Lake/data lakehouse architectures, real-time reporting with Power BI, and end-to-end CI/CD automation with Azure DevOps. Strong in stakeholder requirement gathering, data quality/lineage monitoring, and implementing RBAC/IAM controls for secure, compliant enterprise data platforms.
Skills
Language
Work Experience
Data Engineer at P.F. Chang's
May 1, 2024 - February 1, 2026Led stakeholder management and requirement gathering, translating business needs into technical specifications and reducing project rework by 25%, with improved delivery alignment. Implemented automated ETL pipelines using DataBricks, Microsoft Fabric, Unity Catalog, Azure Synapse, Python, and PySpark to process 500M records daily. Optimized ETL performance using PySpark, reducing processing time by 35% and improving throughput and scalability. Built metadata-driven pipelines integrating Delta Lake, Azure Purview, ADLS Gen2, and Unity Catalog for data quality monitoring and enhanced lineage/governance. Designed robust data warehouse and lake solutions using Delta Lake principles and improved query performance. Implemented governance controls with IAM and RBAC to restrict data access by role, improving security compliance by 20%. Built dynamic Power BI dashboards for near real-time insights, improving decision speed by 30%. Established end-to-end CI/CD pipelines with Azure DevOps to red
Data Engineer at P.F Changs
May 1, 2024 - February 1, 2026Led stakeholder management and requirements gathering, translating business needs into technical specifications and reducing project rework by 25%. Implemented an automated ETL pipeline using DataBricks, Microsoft Fabric, Unity Catalog, Azure Synapse, Python, and PySpark to process 500M records daily. Optimized PySpark-based ETL pipelines to reduce processing time by 35%, improving throughput and scalability. Built metadata-driven pipelines integrating Delta Lake, Azure Purview, ADLS Gen2/ADLS, and Python scripting within DataBricks and Azure Data Factory to improve data quality monitoring and lineage transparency. Designed dynamic Power BI dashboards for near real-time insights, improving decision speed by 30%. Architected robust DWH and data lake solutions using Delta Lake design principles for scalable storage and optimized query performance. Implemented data governance protocols including IAM and RBAC to restrict data access by role, improving security compliance by 20%. Integrated
Data Engineer at AKC Pet Insurance
August 1, 2021 - October 1, 2022Directed all phases of stakeholder engagement and requirements gathering to define project scopes, improving deliverable clarity and increasing stakeholder satisfaction by 20%. Initiated and led data engineering implementations using DataBricks, Microsoft Fabric, Unity Catalog, Azure Synapse, Python, and PySpark, improving processing speed and pipeline reliability. Optimized large-scale PySpark ETL pipelines to reduce resource consumption costs by 25% while increasing processing throughput. Used Python for complex transformations, ETL workflow orchestration, and automated unit/integration testing, reducing manual intervention by 40%. Developed metadata-driven ETL pipelines leveraging Delta Lake, Azure Purview, and ADLS to enhance lineage, traceability, and governance visibility. Enforced data governance using IAM and RBAC across Azure and AWS environments. Coordinated ingestion workflows via Apache Airflow and Azure Data Factory with strong failure recovery mechanisms. Collaborated on
MSBI Developer at Procter & Gamble
September 1, 2020 - July 1, 2021Managed stakeholders and gathered detailed requirements for integrating Azure and SAP data sources, delivering 15% ahead of schedule while improving team alignment. Spearheaded new Azure DataBricks and Azure Synapse projects using Python and PySpark to build scalable pipelines on Delta Lake with 30% pipeline performance gains. Leveraged PySpark to reduce processing runtimes by 40% for complex hybrid cloud environments supporting large-scale analytical workloads. Automated ETL testing and data validation using Python scripts, improving data accuracy and reducing manual testing effort by 50%. Built metadata-driven ETL pipelines with Delta Lake, ADLS, and Azure Purview to improve compliance, audit readiness, and governance for regulated environments. Built interactive Power BI dashboards using SAP BW and Azure SQL data to accelerate insights delivery and reporting generation by 25%. Designed DWH and data lake architecture aligned with Delta Lake to optimize storage, reduce latency, and im
MSBI Developer at Spirit Airlines
February 1, 2020 - September 1, 2020Led stakeholder engagement and requirements gathering for BI and ETL implementations across multiple data platforms, improving alignment with business objectives and increasing user satisfaction by 20%. Delivered new project implementations integrating SSIS, SAS, Power BI, and Tableau to automate data pipelines and improve reporting capabilities, achieving 35% faster report turnaround. Optimized SSIS ETL processes to improve data load performance by over 30%. Automated data pipeline testing using Python and PowerShell to improve data accuracy and reduce defects, increasing ETL reliability and operational efficiency. Leveraged metadata-driven ETL design principles using Alteryx, SAP systems, and Power BI to improve lineage visibility, governance, traceability, and reporting accuracy. Developed enterprise data warehouses and data marts integrating SAP and Microsoft BI ecosystem. Implemented data governance including IAM and RBAC for secure access and improved organizational data stewards
Education
Qualifications
International Project Management (with Professional Experience) (Master’s)
September 1, 2022 - December 1, 2024Bachelor of Science in Computer Science
July 1, 2017 - December 1, 2020Microsoft Certified: Azure Data Engineer Associate (DP-203)
January 11, 2030 - August 20, 2026Microsoft Certified: Power BI Data Analyst Associate (PL-300)
January 11, 2030 - August 20, 2026Databricks Certified Data Engineer Associate
January 11, 2030 - August 20, 2026Microsoft Certified: Azure Fundamentals (AZ-900)
January 11, 2030 - August 20, 2026Master's degree (International Project Management with Professional Experience)
September 1, 2022 - December 1, 2024Bachelor of Science in Computer Science
July 1, 2017 - December 1, 2020Microsoft Certified: Azure Data Engineer Associate (DP-203)
January 11, 2030 - August 20, 2026Microsoft Certified: Power BI Data Analyst Associate (PL-300)
January 11, 2030 - August 20, 2026Databricks Certified Data Engineer Associate
January 11, 2030 - August 20, 2026Microsoft Certified: Azure Fundamentals (AZ-900)
January 11, 2030 - August 20, 2026Industry Experience
Software & Internet, Professional Services, Financial Services
Skills
Hire a Data Engineer
We have the best data engineer experts on Twine. Hire a data engineer in London today.