My 18-year data-domain experience can be found from my resume, but not listed on my resume are my passions on new stuff learning and applying for any business scenarios creatively they need!

Frank Fan

My 18-year data-domain experience can be found from my resume, but not listed on my resume are my passions on new stuff learning and applying for any business scenarios creatively they need!

Available to hire

My 18-year data-domain experience can be found from my resume, but not listed on my resume are my passions on new stuff learning and applying for any business scenarios creatively they need!

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
See more

Language

English
Fluent

Work Experience

Sr. Data Engineer at Office of the Superintendent of Financial Institutions (OSFI)
March 1, 2025 - November 7, 2025
Lead data model development for MDM-driven DW migrations from on-premise to Azure (SQL Server, SSIS, Power BI). Designed and mapped schema migrations, troubleshooted legacy SSIS issues, and shaped cloud migration strategies. Implemented ETL/ELT pipelines within Azure Synapse (ADF, Spark pools) and contributed to capacity planning in Azure Fabric. Built Power BI semantic models and dataflows to support governance and analytics.
Sr. Cloud Consultant (Integration) at CIBC
March 1, 2025 - March 1, 2025
Delivered cloud-first data engineering across Salesforce Data Cloud, Azure, AWS and Databricks to support DW/BI/AI solutions. Designed data flows for ECRAM ecosystem integrations, aligned pipelines with medallion architecture (landing, processing, curated), and implemented Unity Catalog enablement for Databricks. Enhanced GenAI readiness with semantic data models and prompt engineering for Salesforce Data Cloud and Azure OpenAI, leveraging Databricks for serverless SQL and ML workflows.
Sr. Azure Data Consultant (ML/AI) at Natural Science & Engineering Research Council (NSERC)
June 1, 2024 - June 1, 2024
Provided Azure cloud data engineering consulting for system migration, ETL pattern design, and infrastructure configurations in Synapse, ADF, Databricks, MLflow and OpenAI. Implemented Unity Catalog integrations, medallion delta lake architectures, and semantic data models aligned with ML/AI solutions. Mentored ETL/ELT pipelines design and implementation; evaluated Azure ML/AI Studio against Databricks features.
Sr. Data Consultant at Export Development Canada (EDC)
November 1, 2023 - November 1, 2023
Designed ESG-PCAF data architectures in Azure to align with enterprise standards, mapping on-premise processes to data mesh concepts using Azure Databricks, Synapse, ADLS, Oracle, Data Stage, MDM and data governance. Led cloud migrations, reviewed Databricks code, and delivered complex SQL mappings for analytics, with data governance and CI/CD considerations.
Sr. Data Engineer at Canada Border Services Agency (CBSA)
May 1, 2023 - May 1, 2023
Provided cloud data analytics solutions focusing on Azure/Snowflake/Databricks integrations, ETL/ELT design, REST API ingestion, and POC work to simulate legacy Data Stage flows. Designed metadata-driven data models, data governance with Purview and Unity Catalog, and built scalable pipelines (ADF + Databricks) to support secure analytics.
Sr. Data Engineer at Canada Border Services Agency (CBSA)
February 1, 2024 - February 1, 2024
Continued CBSA cloud analytics work with data integration across Azure, Snowflake and Databricks; advanced data pipelines, governance patterns, and security controls; contributed to incremental ML/AI data flows and compliance alignment.
Sr. Data Architect / Data Engineer at Scotiabank
February 1, 2022 - February 1, 2022
Led MDM data modeling and development across Azure SQL, Oracle, and on-prem systems; built CPPA-compliant data governance and reporting pipelines; translated business requirements into technical specs; migrated data sources; restructured reporting engines; guided ETL development with SSIS/ADF and end-to-end SDLC governance.
Sr. Cloud Data Engineer at Innovapost/Canada Post
June 1, 2021 - June 1, 2021
Advised on EDW cloud migrations and ML data models on Azure (AI Search, Azure ML, Azure SQL, ADF, Databricks); implemented MDM with Unity Catalog and Purview; designed CI/CD pipelines for data solutions; orchestrated cloud data migrations across subscriptions.
Sr. Data Architect / Data Engineer at OMERS
October 1, 2020 - October 1, 2020
Provided technical leadership in DW planning, implementation and delivery (SQL Server/Azure SQL, SSAS, SSIS, ADF, Informatica, Oracle, Power BI). Led MDM design and metadata governance, built security strategies and CI/CD pipelines, and guided transitions to modern cloud/on‑prem architectures with agile execution.
Lead Data Engineer at CETARIS
October 1, 2019 - October 1, 2019
Led data engineering and MDM initiatives, implemented data governance, designed 3-tier data storage, optimized ETL/ELT with SSIS/ADF/Databricks and Data Lake, and guided cloud migration roadmaps to Azure-based data solutions; ensured CPPA-compliant data protection.
Sr. Database Analyst at FCT
September 1, 2018 - September 1, 2018
Architected enterprise OLTP/OLAP/MDM data models, governed data maintenance, and led architecture upgrades for SQL Server, Oracle, Java/.Net environs. Designed migration roadmaps toward Azure data solutions; implemented data protection and ETL pipelines using SSIS, Informatica, and ADF.
Sr. Data Engineer, Data Engineering Team Lead at VIGILANT GLOBAL (DRW HOLDINGS)
May 1, 2016 - May 1, 2016
Led analytics architecture for financial trading platforms, including relational, dimensional and graph modeling. Built data warehouses, big data lakes, and note-worthy graph ontologies; collaborated with data scientists on ML models; established data governance and BI reporting via Tableau/Power BI; drove agile delivery and data standards.
Database Architect/Developer at PSL Group Consulting
March 1, 2007 - March 1, 2007
Provided database support to developers/QA/PM; built ETL with DTS/SSIS; developed data models and database objects; evaluated company-wide CMS data strategies and integration plans for legacy systems.
SQL Server Developer/.Net Programmer at Autoland
May 1, 2006 - May 1, 2006
RDBMS modeling and programming; web site development and IIS administration; data analysis and modeling; design of database structures and application data access APIs.
Sr. Azure Data Consultant (ML/AI) at NSERC
June 1, 2024 - June 1, 2024
Provide Azure cloud data engineering consulting for migration, ETL/data flow pattern design and infra configurations (Synapse, ADF, Databricks, MLflow, OpenAI); integrate Azure services with Databricks (Unity Catalog); evaluate medallion Delta Lake architectures and semantic data models for ML/AI solutions; mentor ETL/ELT design and implementation.

Education

Graduate Diploma in Computer Science at Concordia University
January 1, 2001 - January 1, 2004
AEC in Computer Science at O’Sullivan College
January 1, 1999 - January 1, 2000
Project Management at McGill University
January 1, 2008 - January 1, 2008
Project Management at McGill University
January 11, 2030 - January 1, 2008
Graduate Diploma, Computer Science at Concordia University
January 1, 2001 - January 1, 2004
AEC, Computer Science at O’Sullivan College
January 1, 1999 - January 1, 2000

Qualifications

Scrum Master Certified
January 11, 2030 - November 7, 2025
Scrum Master Certification
January 11, 2030 - November 7, 2025
TOGAF
January 11, 2030 - November 7, 2025
Agile Practitioner
January 11, 2030 - November 7, 2025

Industry Experience

Financial Services, Government, Professional Services, Software & Internet, Education, Computers & Electronics