Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am a dynamic data engineer with 5+ years of hands-on experience building scalable data architectures and real-time pipelines. I design, develop, and support Azure-based data platforms. I excel in Databricks administration, PySpark, and SQL for robust data pipelines, and I bring expertise in Azure Data Factory, Delta Lake, and Unity Catalog for governance. I thrive on translating complex technical solutions into business-friendly insights, collaborating with stakeholders, and delivering CI/CD-driven deployments.…I am a dynamic data engineer with 5+ years of hands-on experience building scalable data architectures and real-time pipelines. I design, develop, and support Azure-based data platforms. I excel in Databricks administration, PySpark, and SQL for robust data pipelines, and I bring expertise in Azure Data Factory, Delta Lake, and Unity Catalog for governance. I thrive on translating complex technical solutions into business-friendly insights, collaborating with stakeholders, and delivering CI/CD-driven deployments.

DINESH P ABBA

Data Scientist, Full Stack Developer, Developer, +2





I am a dynamic data engineer with 5+ years of hands-on experience building scalable data architectures and real-time pipelines. I design, develop, and support Azure-based data platforms. I excel in Databricks administration, PySpark, and SQL for robust data pipelines, and I bring expertise in Azure Data Factory, Delta Lake, and Unity Catalog for governance. I thrive on translating complex technical solutions into business-friendly insights, collaborating with stakeholders, and delivering CI/CD-driven deployments.…I am a dynamic data engineer with 5+ years of hands-on experience building scalable data architectures and real-time pipelines. I design, develop, and support Azure-based data platforms. I excel in Databricks administration, PySpark, and SQL for robust data pipelines, and I bring expertise in Azure Data Factory, Delta Lake, and Unity Catalog for governance. I thrive on translating complex technical solutions into business-friendly insights, collaborating with stakeholders, and delivering CI/CD-driven deployments.

Available to hire

I am a dynamic data engineer with 5+ years of hands-on experience building scalable data architectures and real-time pipelines. I design, develop, and support Azure-based data platforms.

I excel in Databricks administration, PySpark, and SQL for robust data pipelines, and I bring expertise in Azure Data Factory, Delta Lake, and Unity Catalog for governance. I thrive on translating complex technical solutions into business-friendly insights, collaborating with stakeholders, and delivering CI/CD-driven deployments.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Language

English

Advanced

Work Experience

Cloud Data Engineer at TD Bank

January 1, 2024 - Present

Led end-to-end design and implementation of large-scale fraud detection data pipelines. Ingested data into Azure Data Lake Storage using Azure Data Factory, integrated APIs and JSON sources, and applied PySpark/Databricks to enable real-time fraud scoring with FICO AI. Built a feedback loop to add new fraud rules, optimized ETL/ELT workloads, and implemented partitioning, caching, and broadcast joins to improve query performance by 40%. Established governance with Unity Catalog and Purview, and configured monitoring with Datadog and CloudWatch. Implemented CI/CD with Azure DevOps and containerized deployments to ensure reliable production operations. Monitored over 1B+ transactions annually.

Data Engineer at Sobeys

October 1, 2022 - December 1, 2023

Built real-time inventory tracking pipelines using ADF and Databricks, streaming data via Apache Kafka and Apache Flink into ADLS. Developed PySpark and Python-based transformations, enabling ACID Delta Lake storage, schema evolution, and quality checks. Implemented end-to-end governance with Azure Purview and Unity Catalog, and delivered OLTP/OLAP models in Snowflake and Power BI. Automated deployment with CI/CD (Azure DevOps, Jenkins) and containerized builds; ensured data masking for PII and lineage tracking. Collaborated with business stakeholders to align analytics with retail operations and delivered self-service dashboards.

Business Intelligence Developer at DTDC

May 1, 2018 - April 1, 2021

Migrated SQL Server SSIS packages to PySpark within ADF/Databricks, enabling data movement from on-prem sources to Azure Data Lake and Databricks. Built interactive Power BI dashboards for real-time logistics performance, and designed Medallion-based data pipelines (Bronze/Silver/Gold) with data quality checks. Implemented optimized data warehousing in Azure Synapse and SQL Server, plus automated ETL pipelines and governance with Purview. Led cloud migration from on-prem SQL to Azure Synapse/ADLS and established scalable, auditable data flows.