Available to hire
I am Chandrika, an Azure Data Engineer with around 4 years of experience building scalable data solutions. I specialize in ETL pipelines, data governance, and BI using Azure, ADF, Databricks, Fabric, Power BI, and PySpark. I focus on big data processing to optimize performance, automate processes, and ensure high-quality data for decision-making.
I excel at collaborating with stakeholders to gather requirements and translate them into practical data architectures. I have led projects delivering Delta Lake/Unity Catalog-based data pipelines, implemented governance controls (IAM, RBAC), and trained teams on Databricks, Power BI, and Azure Synapse to enable data-driven decisions.
Language
English
Fluent
Work Experience
Azure Data Engineer at PLM CAD UTILITIES AS
October 1, 2024 - November 10, 2025Designed and optimized ETL pipelines in Azure Data Factory using Python and PySpark, improving data processing speeds by 30%. Led the implementation of a Databricks-based project with Unity Catalog and Delta Lake to manage large datasets, reducing processing time by 20% and ensuring high data quality and governance. Automated ETL processes with Python tests, built metadata-driven pipelines, and designed scalable Power BI dashboards for real-time analytics. Implemented IAM/RBAC governance across Azure Data Lake and Synapse, migrated ETL from on-premises to cloud, and delivered training sessions on Databricks, Power BI, and Azure Synapse.
Azure Data Engineer at PLM CAD UTILITIES AS
September 30, 2024 - September 30, 2024Delivered a greenfield project using Databricks, Unity Catalog, Synapse, Python, and PySpark to improve modularity and data accessibility for analysts, reducing overall data refresh times by 30%. Optimized ingestion of multi-format data (JSON, CSV, Parquet) using PySpark and parallel processing, achieving significant performance gains. Developed automated test cases and validation scripts to ensure consistent ETL outputs and early error detection. Created centralized data visualizations with Power BI connected to Azure SQL DB for real-time and historical KPIs, and implemented metadata-driven pipelines with ADF, Databricks, Delta Lake, and Azure Purview. Implemented IAM/RBAC, integrated external datasets (S3, CosmosDB, CRM), used Airflow for DAG orchestration, and provided training documentation.
Azure Data Engineer at Siemens
December 31, 2023 - December 31, 2023Led the design of an analytics platform using Databricks, Synapse, Unity Catalog, Python, and PySpark, integrating siloed hospital datasets into a centralized reporting ecosystem. Used PySpark to process 1.5 TB of daily patient records, reducing ETL run time by 40%. Developed Python test automation for data quality, created Delta Lake pipelines with ADLS and Azure Purview, and built Power BI dashboards to support leadership decisions. Migrated ETL from SSIS to ADF and Databricks, enhanced SSAS cubes for multidimensional analysis, standardized ingestion from SAP BW/BO into Azure Data Lake, and implemented Git-based development workflows with Azure DevOps for deployment automation. Optimized Azure SQL queries to improve time-sensitive reporting.
Azure Data Engineer at PLM CAD UTILITIES AS
August 31, 2022 - August 31, 2022Implemented data warehouse and data lake architecture using Delta Lake concepts, rebuilt SSIS/SSAS/SSRS reporting, and introduced Alteryx for data cleaning to reduce manual reporting errors. Applied IAM/RBAC to govern access to BI tools and data sources, designed financial KPIs with Power BI, and built region-specific Tableau views to support global teams. Managed version control with Git, deployed DevOps pipelines for Databricks configurations, and built dashboards for sales and inventory analytics to drive data-driven decisions.
Azure Data Engineer at PLM CAD UTILITIES AS
September 1, 2024 - September 1, 2024Collaborated with compliance and product teams to turn requirements into governed data workflows, improving stakeholder satisfaction. Delivered a greenfield project using Databricks, Unity Catalog, and Synapse with Python and PySpark, improving modularity and data accessibility and reducing data refresh times by 30%. Optimized ingestion of JSON, CSV, and Parquet with PySpark and parallel processing, achieving 40% performance improvement. Developed automated tests and validation scripts in Python to ensure ETL reliability. Implemented metadata-driven pipelines using ADF, Databricks, Delta Lake, Azure Purview, and Python to boost reuse and ease transitions. Created centralized Power BI visuals connected to Azure SQL DB for real-time and historical KPI tracking. Designed Delta Lake-based Data Lake and Data Warehouse architecture for storage, auditability, and versioning. Applied IAM and RBAC to safeguard sensitive data and ensure compliance. Integrated external datasets from S3, Cosmos DB
Azure Data Engineer at Siemens
December 1, 2023 - December 1, 2023Led design of analytics platform using Databricks, Synapse, Unity Catalog, Python, and PySpark, integrating siloed hospital datasets into a centralized reporting ecosystem. Used PySpark to process 1.5 TB of daily patient records, reducing ETL run time by 40% and improving workflow efficiency. Developed Python test automation for data quality, reducing post-deployment incidents. Created metadata-driven pipelines with Delta Lake, ADF, Azure Purview, and ADLS to automate source-to-target mappings and handle schema evolution. Built Power BI dashboards presenting KPIs to leadership and identifying resource bottlenecks. Designed Delta Lake-based Data Lake and Data Warehouse with raw, curated, and presentation zones to manage data lifecycle. Implemented IAM and RBAC for HIPAA-aligned access controls. Migrated ETL jobs from SSIS to ADF and Databricks, improving maintainability and cloud scalability. Enhanced SSAS cubes for multidimensional analysis and integrated with Power BI. Standardized in
Azure Data Engineer at PLM CAD UTILITIES AS
August 1, 2022 - August 1, 2022Gathered analytical requirements with cross-functional stakeholders; aligned report delivery with product and marketing planning. Implemented new Data Warehouse design using SSIS, SSAS, and Delta Lake concepts, improving OLAP capability and consistent reporting metrics. Used Alteryx to clean and transform sales and inventory data, reducing manual errors. Designed Tableau dashboards and Power BI reports for global and local teams, unifying visualization strategies. Rebuilt legacy SSRS reports with parameterized views to improve performance and mobile usability. Applied IAM and RBAC to govern BI tool access. Transitioned SAP ECC extract reports to centralized reporting via SSAS and Alteryx, improving data consistency and historical trend analysis. Maintained Git version control and implemented pull requests. Built financial KPIs and variance reports in Power BI with DAX for drill-through and row-level security. Developed dynamic data sources and filters in Tableau for multi-region views.
Education
MSc in Advanced Computer Science and Engineering at University of Leicester
October 1, 2023 - November 1, 2024MSc in Advanced Computer Science and Engineering at University of Leicester
October 1, 2023 - November 1, 2024Qualifications
Industry Experience
Software & Internet, Professional Services, Healthcare, Life Sciences
Hire a Database Developer
We have the best database developer experts on Twine. Hire a database developer in Leicester today.