Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am an accomplished Senior Data Solution Architect with 10+ years of experience designing, implementing, and optimizing large-scale data infrastructure and analytics solutions. I have deep expertise in the Databricks platform, Lakehouse architectures, MLflow, Unity Catalog, and Apache Spark with SQL/Python/Scala optimization for petabyte-scale data processing. I have led many on-premises-to-cloud and cloud-to-cloud migrations, built real-time data pipelines and data stores, and collaborated as a client-facing solution architect with Google Cloud Premium Partners and GPSO. I thrive in cross-functional teams and am passionate about applying AI/ML technology stacks to business problems. I have successfully delivered complex cloud migrations, data estate consolidation, and advanced analytics solutions across industries, leveraging Azure, GCP, and AWS while focusing on data governance, lineage, and scalable architectures. I enjoy mentoring teams, driving workshops, and turning strategic data insights into practical business value.…I am an accomplished Senior Data Solution Architect with 10+ years of experience designing, implementing, and optimizing large-scale data infrastructure and analytics solutions. I have deep expertise in the Databricks platform, Lakehouse architectures, MLflow, Unity Catalog, and Apache Spark with SQL/Python/Scala optimization for petabyte-scale data processing. I have led many on-premises-to-cloud and cloud-to-cloud migrations, built real-time data pipelines and data stores, and collaborated as a client-facing solution architect with Google Cloud Premium Partners and GPSO. I thrive in cross-functional teams and am passionate about applying AI/ML technology stacks to business problems. I have successfully delivered complex cloud migrations, data estate consolidation, and advanced analytics solutions across industries, leveraging Azure, GCP, and AWS while focusing on data governance, lineage, and scalable architectures. I enjoy mentoring teams, driving workshops, and turning strategic data insights into practical business value.

Sanjay Sharma

Data Scientist, Full Stack Developer, Web Developer, +2





I am an accomplished Senior Data Solution Architect with 10+ years of experience designing, implementing, and optimizing large-scale data infrastructure and analytics solutions. I have deep expertise in the Databricks platform, Lakehouse architectures, MLflow, Unity Catalog, and Apache Spark with SQL/Python/Scala optimization for petabyte-scale data processing. I have led many on-premises-to-cloud and cloud-to-cloud migrations, built real-time data pipelines and data stores, and collaborated as a client-facing solution architect with Google Cloud Premium Partners and GPSO. I thrive in cross-functional teams and am passionate about applying AI/ML technology stacks to business problems. I have successfully delivered complex cloud migrations, data estate consolidation, and advanced analytics solutions across industries, leveraging Azure, GCP, and AWS while focusing on data governance, lineage, and scalable architectures. I enjoy mentoring teams, driving workshops, and turning strategic data insights into practical business value.…I am an accomplished Senior Data Solution Architect with 10+ years of experience designing, implementing, and optimizing large-scale data infrastructure and analytics solutions. I have deep expertise in the Databricks platform, Lakehouse architectures, MLflow, Unity Catalog, and Apache Spark with SQL/Python/Scala optimization for petabyte-scale data processing. I have led many on-premises-to-cloud and cloud-to-cloud migrations, built real-time data pipelines and data stores, and collaborated as a client-facing solution architect with Google Cloud Premium Partners and GPSO. I thrive in cross-functional teams and am passionate about applying AI/ML technology stacks to business problems. I have successfully delivered complex cloud migrations, data estate consolidation, and advanced analytics solutions across industries, leveraging Azure, GCP, and AWS while focusing on data governance, lineage, and scalable architectures. I enjoy mentoring teams, driving workshops, and turning strategic data insights into practical business value.

Available to hire

I am an accomplished Senior Data Solution Architect with 10+ years of experience designing, implementing, and optimizing large-scale data infrastructure and analytics solutions. I have deep expertise in the Databricks platform, Lakehouse architectures, MLflow, Unity Catalog, and Apache Spark with SQL/Python/Scala optimization for petabyte-scale data processing. I have led many on-premises-to-cloud and cloud-to-cloud migrations, built real-time data pipelines and data stores, and collaborated as a client-facing solution architect with Google Cloud Premium Partners and GPSO. I thrive in cross-functional teams and am passionate about applying AI/ML technology stacks to business problems.

I have successfully delivered complex cloud migrations, data estate consolidation, and advanced analytics solutions across industries, leveraging Azure, GCP, and AWS while focusing on data governance, lineage, and scalable architectures. I enjoy mentoring teams, driving workshops, and turning strategic data insights into practical business value.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Data Engineer at Alberta Energy Regulator

August 1, 2025 - August 1, 2025

Architected the Cloud Data Estate on Azure SQL and Databricks, including Metastore, Unity Catalog, and Medallion Architecture (Bronze-Silver-Gold). Created High-Level and Low-Level designs for Azure Data Factory and Databricks pipelines; designed JSON schemas for data microservices APIs; implemented real-time JSON data validation using Azure Machine Learning Service.

Data Engineer, Real Time Data Integration to BigQuery and Databricks at BrightSpeed Inc

January 1, 2024 - January 1, 2024

Led requirements gathering, defined Bronze/Silver/Gold medallion data models for BigQuery and Databricks; built real-time ingestion pipelines using Kafka, PubSub, Dataflow, and Databricks Auto Loader; performed ELT in BigQuery and PySpark notebooks.

Machine Learning Engineer at Google Inc

March 1, 2023 - March 1, 2023

Part of the Google Partner Service Organization (GPSO) Center of Excellence; enhanced Partner Recommendation System using Document AI and ML; developed Partner Ranking algorithms; deployed AI applications on GKE and pipelines via CloudBuild; leveraged Dataplex data catalogs for dataset discovery.

Data Solution Architect, Cloud Migration at Synopsys Inc

November 1, 2022 - November 1, 2022

Migrated KB Factory Spark-based on-prem data processing workloads to Google Cloud Dataflow; produced as-is to to-be architectures, gap analyses, and transition roadmaps; authored migration scripts, runbooks, and post-migration validation plans.

Data Solution Architect, Inter-Cloud Migration at Ford Motor Co.

April 1, 2022 - April 1, 2022

Led design for migrating 52-node Kafka cluster, 60 Oracle databases, and 150 microservices from AWS to Google Cloud; delivered current state vs. target state architectures, gap analyses, transition plans, and migration scripts.

Data Engineer at Insurance Corporation of British Columbia (ICBC)

March 1, 2021 - March 1, 2021

Architected pipelines to extract policy center transaction data for Uber/Lyft telematics policies; integrated data into MAP-R Hadoop-based data warehouse; designed dimensional data model and mapped source-to-target data flows.

Azure Data Solution Architect, On-Prem to Cloud Migration at Teck Resources

December 1, 2020 - December 1, 2020

Migrated mining-site data from on-prem SQL Server to Azure SQL and Synapse; launched data governance initiatives with Collibra; built data pipelines in Azure Data Factory; established data catalogs and data quality frameworks.

Data Engineer, Telematics Data Integration at Insurance Corporation of British Columbia (ICBC)

September 1, 2019 - September 1, 2019

Architected telemetry data integration pipelines for real-time processing and integration into downstream systems; implemented PySpark batch processing for telemetry streams.

Data Architect, Data Lake Implementation at BC Hydro Corporation

March 1, 2019 - March 1, 2019

Designed a Hadoop-based data lake architecture; defined conceptual/logical/physical data models, data flows, lineage, and governance policies; implemented ETL and analytics layers and governed data assets.

Data Engineer, Real Time Data Ingestion Pipeline at Mobidia Inc.

December 1, 2014 - December 1, 2014

Built real-time data ingestion and storage pipelines on AWS using Kinesis and Redshift; developed microservices, RESTful APIs, and TOGAF-aligned architecture artifacts for mobile analytics platform.

Data Architect, Mobile Banking Application at Servus Credit Union

January 1, 2014 - January 1, 2014

Developed TOGAF-aligned architectural artifacts; designed backend data models for mobile banking application and ensured data integration with downstream analytics.

Tech Lead, Data Platform migration from MySQL to Percona Cluster at Digital Payment Technologies

September 1, 2013 - September 1, 2013

Led data platform migration efforts, overseeing data integration, schema conversion, and performance tuning to migrate SAAS data to Percona Cluster.

Data Architect, Critical Infrastructure Vulnerability Scan Database at Wurldtech Securities

May 1, 2013 - May 1, 2013

Led database design for vulnerability scan data; created data models and data flows to support analytics and reporting.

TOGAF 9 Consultant for Enterprise Application Optimization at Fortis BC

October 1, 2012 - October 1, 2012

Developed architectural artifacts and led enterprise application optimization initiatives following TOGAF guidelines.

Data Architect, ODS for Canadian Armed Forces at Boeing Corp

July 1, 2012 - July 1, 2012

Designed 3NF transactional ODS databases for helicopter fleet data; implemented Oracle-based data processing workflows.

Data Quality Consultant at TransLink Inc

January 1, 2012 - January 1, 2012

Developed data quality packages and governance artifacts to improve analytics readiness.

Data Architect, Enterprise Data Warehouse at Insurance Corporation of British Columbia (ICBC)

September 1, 2011 - September 1, 2011

Streamlined corporate data warehouse architecture; designed conceptual/logical/physical models; built ETL processes and data mappings.

Web Application Architect at Office of Information and Privacy Commissioner (OIPC)

July 1, 2009 - July 1, 2009

Built web application back-end data models; designed TOGAF-aligned architecture for registration framework.

Medplus Application Conversion Lead at Ministry of Health, Government of British Columbia

September 1, 2008 - September 1, 2008

TOGAF-based solution design for application integration; led migration and modernization efforts.

Senior Oracle Data Engineer at Maximus Inc. (Sacramento)

February 1, 2007 - February 1, 2007

Developed backend database solutions for Medicaid Management System across multiple states; implemented Oracle-based data processing.