Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Data Engineer with 6+ years of experience designing and delivering end-to-end data solutions on Microsoft Azure in banking, financial services, and enterprise environments. Specialized in ETL/ELT pipelines and Lakehouse platforms using Azure Data Factory, Azure Databricks (PySpark), Synapse Analytics, and Microsoft Fabric, with strong command of data modeling, distributed processing, and data warehouse modernization. Experienced ingesting and transforming data from diverse sources into governed, analytics-ready data products. Skilled in performance tuning, building CI/CD with Azure DevOps, and enforcing data governance and compliance (Purview, RBAC, encryption) for regulated domains such as GDPR and PIPEDA—partnering with business stakeholders and data teams to deliver reliable production pipelines and optimize for cost and performance.…Data Engineer with 6+ years of experience designing and delivering end-to-end data solutions on Microsoft Azure in banking, financial services, and enterprise environments. Specialized in ETL/ELT pipelines and Lakehouse platforms using Azure Data Factory, Azure Databricks (PySpark), Synapse Analytics, and Microsoft Fabric, with strong command of data modeling, distributed processing, and data warehouse modernization. Experienced ingesting and transforming data from diverse sources into governed, analytics-ready data products. Skilled in performance tuning, building CI/CD with Azure DevOps, and enforcing data governance and compliance (Purview, RBAC, encryption) for regulated domains such as GDPR and PIPEDA—partnering with business stakeholders and data teams to deliver reliable production pipelines and optimize for cost and performance.

Indraja B

Data Engineer, Data Scientist, Software Engineer, +2





Data Engineer with 6+ years of experience designing and delivering end-to-end data solutions on Microsoft Azure in banking, financial services, and enterprise environments. Specialized in ETL/ELT pipelines and Lakehouse platforms using Azure Data Factory, Azure Databricks (PySpark), Synapse Analytics, and Microsoft Fabric, with strong command of data modeling, distributed processing, and data warehouse modernization. Experienced ingesting and transforming data from diverse sources into governed, analytics-ready data products. Skilled in performance tuning, building CI/CD with Azure DevOps, and enforcing data governance and compliance (Purview, RBAC, encryption) for regulated domains such as GDPR and PIPEDA—partnering with business stakeholders and data teams to deliver reliable production pipelines and optimize for cost and performance.…Data Engineer with 6+ years of experience designing and delivering end-to-end data solutions on Microsoft Azure in banking, financial services, and enterprise environments. Specialized in ETL/ELT pipelines and Lakehouse platforms using Azure Data Factory, Azure Databricks (PySpark), Synapse Analytics, and Microsoft Fabric, with strong command of data modeling, distributed processing, and data warehouse modernization. Experienced ingesting and transforming data from diverse sources into governed, analytics-ready data products. Skilled in performance tuning, building CI/CD with Azure DevOps, and enforcing data governance and compliance (Purview, RBAC, encryption) for regulated domains such as GDPR and PIPEDA—partnering with business stakeholders and data teams to deliver reliable production pipelines and optimize for cost and performance.

Available to hire

Data Engineer with 6+ years of experience designing and delivering end-to-end data solutions on Microsoft Azure in banking, financial services, and enterprise environments. Specialized in ETL/ELT pipelines and Lakehouse platforms using Azure Data Factory, Azure Databricks (PySpark), Synapse Analytics, and Microsoft Fabric, with strong command of data modeling, distributed processing, and data warehouse modernization.

Experienced ingesting and transforming data from diverse sources into governed, analytics-ready data products. Skilled in performance tuning, building CI/CD with Azure DevOps, and enforcing data governance and compliance (Purview, RBAC, encryption) for regulated domains such as GDPR and PIPEDA—partnering with business stakeholders and data teams to deliver reliable production pipelines and optimize for cost and performance.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Intermediate

Intermediate

Intermediate

Beginner

Beginner

Language

Work Experience

Azure Data Engineer at ScotiaBank

February 1, 2022 - Present

Designed and developed ETL/ELT pipelines in Azure Data Factory to ingest data from core banking systems, Oracle and SQL Server databases, REST APIs, and flat files into ADLS Gen2 for fraud detection, regulatory reporting, and customer analytics. Built a Medallion (Bronze/Silver/Gold) Lakehouse on ADLS Gen2 with Delta Lake, handling schema evolution to prevent pipeline breakages. Developed PySpark transformations in Azure Databricks for cleansing, deduplication, joins, and aggregations. Engineered near real-time streaming ingestion with Azure Event Hubs and Stream Analytics, reducing fraud-detection latency by 30%. Migrated on-prem SQL Server workloads to Azure Synapse Analytics and redesigned data models for cloud scalability. Implemented CI/CD for ADF and Databricks using Azure DevOps with Git and YAML pipelines. Enforced governance and security using Purview, RBAC, Key Vault, encryption, and data quality checks integrated into CI/CD. Optimized costs by right-sizing clusters and tieri

Data Engineer at HCL Technologies

November 1, 2020 - December 1, 2021

Designed and developed ETL pipelines using Azure Data Factory to ingest data from Oracle, SQL Server, REST APIs, and flat files into a centralized ADLS Gen2 data lake. Built a partitioned ADLS Gen2 data lake with a defined folder hierarchy and lifecycle management policies. Developed PySpark transformations in Azure Databricks for high-volume joins, aggregations, and cleansing. Migrated on-prem data warehouse workloads to Azure Synapse Analytics, including tuning distribution/indexing and enabling analytics on ADLS Gen2 data via Synapse Serverless SQL. Implemented Azure AD-based access control (RBAC), Key Vault-managed encryption, and Azure Monitor/Log Analytics failure alerts. Also supported documentation for source-to-target mapping and error handling.

Data Analyst at HCL Technologies

September 1, 2018 - October 1, 2020

Supported enterprise reporting and analytics by translating business requirements into SQL logic, ETL workflows, and BI dashboards. Built and maintained ETL processes using SSIS to load data into reporting databases and data marts. Developed and optimized complex SQL queries on tables exceeding 100M rows to improve performance and reduce load times. Performed data profiling, validation, and quality checks; created reusable SQL views and stored procedures to standardize business logic. Built SSRS and Power BI dashboards with drill-down capabilities. Contributed to migration of SSIS jobs to Azure Data Factory and partnered with data scientists on feature-engineered datasets for predictive analytics.