Senior Databricks Engineer / SME at Infrastructure Ontario

Acted as a Databricks platform SME supporting enterprise platform architecture, governance, and production operations across development, test, and production. Managed Azure Databricks workspace lifecycle and environment separation, standardized compute via cluster policies and SQL warehouse standards, and implemented Unity Catalog across data domains (metastores, catalogs, schemas, tables, views, volumes, external locations, and credentials). Applied security controls including Entra ID integration, RBAC, row-level access, and column masking; configured service principals for controlled data access to ADLS/OneLake. Monitored and troubleshot Jobs/Workflows, clusters, and SQL Warehouses; investigated failures related to permissions, credentials, and compute or data-processing issues. Built production data pipelines using Python, PySpark, RESTful APIs, Auto Loader, CDC patterns, Delta Lake, incremental processing, and data quality requirements. Supported LLM/RAG initiatives by preparing

Senior Databricks Engineer at Bank Canada

Delivered Databricks engineering and platform solutions supporting enterprise data pipelines, governed Medallion lakehouse workloads, and analytics environments. Worked with Unity Catalog to manage governed access to enterprise data assets; supported workspace, cluster policies, compute standards, SQL Warehouses, and Jobs/Workflows. Developed Spark/PySpark/Python and RESTful API pipelines using incremental processing, data-quality checks, optimization, and production monitoring. Investigated and resolved issues involving jobs, clusters, permissions, credentials, and pipeline failures. Supported Terraform and CI/CD processes for repeatable deployment promotion and contributed to Azure AI Foundry/OpenAI and RAG initiatives using Azure AI Search and embeddings.

Senior Azure Data Engineer at Ontario Health

Built Azure data engineering solutions using Databricks, ADF, ADLS Gen2, Synapse, and Delta Lake for enterprise analytics. Developed Python, PySpark, RESTful API, and SQL pipelines for ingestion, transformation, incremental processing, and data-quality requirements. Applied Medallion/lakehouse patterns and supported governance, access control, metadata/lineage, and production monitoring. Performed root-cause analysis for pipeline failures and supported production remediation; contributed to CI/CD, deployment standards, and documentation.

Lead Consultant / Data Architect at Deloitte Canada

Led data architecture and engineering work for enterprise clients, translating business and platform requirements into scalable cloud data solutions. Designed integration, lakehouse, and analytics architectures using Azure services and Databricks/Spark/SQL. Provided guidance on data modeling, ETL/ELT, security, performance, deployment, and production support. Supported modernization initiatives involving cloud migration and enterprise data integration.

Senior Databricks Engineer at Scotiabank Canada

Developed Databricks and Spark-based data pipelines for banking data integration and analytics. Built Python, PySpark, and SQL transformations with Delta Lake and incremental processing patterns. Worked on data modeling, performance tuning, data-quality validation, and production troubleshooting while supporting enterprise platform standards and deployments.

Senior Databricks Engineer at TD Bank

Senior Data Platform Engineer at Uncor Canada

Senior Big Data Engineer at Zurich Insurance Group

Senior Big Data Consultant at TD Bank

Senior Application Architect at KHP