Azure Data Engineer with 9+ years of experience designing and delivering scalable cloud data platforms on Azure, including Azure Data Factory, Azure Databricks, and Azure Synapse. I build and optimize high-performance ETL/ELT pipelines, data storage, and analytics solutions that improve reliability, scalability, and efficiency. I specialize in both batch and real-time data processing using Event Hubs and Stream Analytics, and I focus strongly on data governance, security, monitoring, and cost optimization. I also help drive migrations and automation using CI/CD and Infrastructure as Code, enabling smooth, production-ready data systems.

Priyanka Verma

Azure Data Engineer with 9+ years of experience designing and delivering scalable cloud data platforms on Azure, including Azure Data Factory, Azure Databricks, and Azure Synapse. I build and optimize high-performance ETL/ELT pipelines, data storage, and analytics solutions that improve reliability, scalability, and efficiency. I specialize in both batch and real-time data processing using Event Hubs and Stream Analytics, and I focus strongly on data governance, security, monitoring, and cost optimization. I also help drive migrations and automation using CI/CD and Infrastructure as Code, enabling smooth, production-ready data systems.

Available to hire

Azure Data Engineer with 9+ years of experience designing and delivering scalable cloud data platforms on Azure, including Azure Data Factory, Azure Databricks, and Azure Synapse. I build and optimize high-performance ETL/ELT pipelines, data storage, and analytics solutions that improve reliability, scalability, and efficiency.

I specialize in both batch and real-time data processing using Event Hubs and Stream Analytics, and I focus strongly on data governance, security, monitoring, and cost optimization. I also help drive migrations and automation using CI/CD and Infrastructure as Code, enabling smooth, production-ready data systems.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate

Work Experience

Azure Data Engineer at PWC, Canada
November 1, 2024 - Present
Designed and implemented scalable data solutions using Azure Data Factory, Azure Synapse, and Azure Databricks for data integration, transformation, and loading. Built and optimized data storage across Azure Blob Storage, Azure Data Lake, and Azure Cosmos DB with partitioning, indexing, and backup strategies. Developed ETL processes for batch and real-time workflows, including big data processing with HDInsight and streaming pipelines with Event Hubs and Stream Analytics. Established CI/CD automation using Azure DevOps, Jenkins, Git/GitHub, and scripting to support reliable deployments. Implemented security and governance using Azure Key Vault, RBAC, encryption, and monitored solutions using Azure Monitor and Log Analytics. Integrated governance capabilities such as Azure Data Catalog, metadata, and lineage; wrote and optimized SQL for ETL and reporting; created Power BI dashboards to deliver actionable insights.
Data Engineer at PWC, Canada
January 1, 2021 - October 31, 2024
Built robust ETL pipelines in Azure Data Factory to integrate data from on-prem databases, cloud storage, and third-party APIs (e.g., SQL Server, Oracle DB, Feed Hub, ServiceNow). Loaded customer data into Azure Data Lake Storage Gen2 and implemented complex transformations and Delta table creation using Python and SQL in Databricks. Added monitoring and data quality checks to ensure integrity and accuracy of processed datasets. Created Azure Logic Apps for automated alerts related to load completion/failure, volume anomalies, and data quality. Developed and tuned scalable analytical data models in Azure Synapse including star/snowflake schemas, performing performance tuning on SQL, transformations, and data movement operations. Coordinated with cross-functional stakeholders using Agile practices and tools such as Jira, Git, and Confluence.
Software Developer at Bank of Baroda, India
January 1, 2015 - August 31, 2019
Designed, developed, and maintained enterprise applications using Java, Python, and SQL with a focus on performance, scalability, and reliability. Managed and optimized Oracle databases for data integrity, efficient retrieval, and query performance tuning. Implemented and troubleshot network protocol configurations (IPv4/IPv6) to ensure connectivity. Conducted code reviews, refactored for performance improvements, and supported deployments to minimize downtime. Built CI/CD pipelines and automated testing frameworks to reduce release errors; prepared support documentation and mentored junior developers.

Education

Bachelors in Computer Science at Maharshi Dayanand University/PDM College of Engineering (Bahadurgarh, Haryana, India)
June 1, 2008 - May 31, 2012
Microsoft Certified: Azure Data Engineering Fundamentals (DP-900) at Microsoft
January 11, 2030 - August 20, 2026

Qualifications

DP-900 Microsoft Certified: Azure Data Engineering Fundamentals
January 11, 2030 - August 20, 2026

Industry Experience

Software & Internet, Professional Services, Computers & Electronics