I'm a results-driven Data Engineer with 4+ years of hands-on experience designing scalable data pipelines, modernizing ETL architectures, and building secure, cloud-based data platforms. I am proficient in Python, SQL, AWS (S3, Glue, Redshift), Snowflake, and dbt, with strong experience in data modeling, orchestration, and pipeline reliability. I have a track record of delivering enterprise BI solutions, optimizing workflows, and collaborating with business stakeholders to enable data-driven decision-making. I also focus on data governance, data residency requirements, secure data handling, and building consistent paved paths for analytics and visualization teams. I am passionate about AI/LLM-driven data workflows, vector database design, and building unified data foundations that democratize access across the organization.

Shuai Wang

I'm a results-driven Data Engineer with 4+ years of hands-on experience designing scalable data pipelines, modernizing ETL architectures, and building secure, cloud-based data platforms. I am proficient in Python, SQL, AWS (S3, Glue, Redshift), Snowflake, and dbt, with strong experience in data modeling, orchestration, and pipeline reliability. I have a track record of delivering enterprise BI solutions, optimizing workflows, and collaborating with business stakeholders to enable data-driven decision-making. I also focus on data governance, data residency requirements, secure data handling, and building consistent paved paths for analytics and visualization teams. I am passionate about AI/LLM-driven data workflows, vector database design, and building unified data foundations that democratize access across the organization.

Available to hire

I’m a results-driven Data Engineer with 4+ years of hands-on experience designing scalable data pipelines, modernizing ETL architectures, and building secure, cloud-based data platforms. I am proficient in Python, SQL, AWS (S3, Glue, Redshift), Snowflake, and dbt, with strong experience in data modeling, orchestration, and pipeline reliability. I have a track record of delivering enterprise BI solutions, optimizing workflows, and collaborating with business stakeholders to enable data-driven decision-making.

I also focus on data governance, data residency requirements, secure data handling, and building consistent paved paths for analytics and visualization teams. I am passionate about AI/LLM-driven data workflows, vector database design, and building unified data foundations that democratize access across the organization.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert

Language

English
Advanced
Chinese
Fluent

Work Experience

IT Developer – Data Engineer at Canada Revenue Agency
January 3, 2023 - March 31, 2025
• Designed and optimized real-time ETL/ELT pipelines using Snowflake, dbt, Python, SQL, and AWS Glue, improving processing performance by 25%. • Implemented layered dbt pipelines (staging → intermediate → marts) and fact/dimension models with SCD handling to support analytics, machine learning inputs, and operational reporting. • Orchestrated and monitored workflows using Airflow, improving observability and reliability across pipelines. • Developed automated data validation and governance checks using Python and Great Expectations, improving pipeline consistency by 15%. • Optimized SQL queries and Python scripts, cutting execution time by 30% and improving data accessibility for analysts and stakeholders. • Conducted root cause analysis to resolve data quality issues across ETL layers, improving stability and trust in downstream dashboards. • Partnered with cross-functional teams to define data requirements and translate them into ingestion, modeling, and reporting patterns. • Delivered secure data integrations compliant with governance and handling standards. • Supported BI analysts & visualization teams, ensuring consistent dataset availability across Power BI and Cognos. • Applied Agile methodology, participating in sprint planning, backlog grooming, and daily stand-ups, ensuring iterative improvements and efficient feature releases. • Utilized Jira to manage issues, backlog tasks, and sprint progress, improving team collaboration and efficiency.
Data Analyst at Carleton University
January 2, 2017 - December 29, 2022
• Designed automated workflows using Python, and Power Automate, reducing manual data processing time by 20%. • Designed and implemented dimensional data models for student records, enabling reliable trend analysis. • Built Power BI reports analyzing student exam records, identifying trends, and delivering actionable insights. • Collaborated with departments across campus (e.g., Academic Advising, Finance) to translate requirements into extraction logic and reproducible workflows. • Implemented error-tolerant and version-controlled pipelines, ensuring resilience to schema changes and facilitating historical comparisons. • Embraced a culture of documentation and reproducibility by maintaining structured metadata and test suites for critical workflows. • Actively participated in Agile rituals and worked with Jira to prioritize and track data infrastructure improvements.
Project Manager at Shanghai Longcheer Technology Co. Ltd.
March 21, 2010 - August 25, 2016
• Led the end -to-end delivery of smartphone projects, managing hardware design, software design, and delivery. • Managed Agile product development cycles, aligning teams with changing customer requirements and ensuring ontime feature delivery. • Developed and maintained the project plan and Work Breakdown Structure (WBS), identifying and prioritizing key project risks to ensure on-time and efficient delivery. • Monitored project status and performance, addressing plan deviations, managing stakeholder change requests, and coordinating evaluations at critical project milestones. • Coordinated cross-functional teams of engineers, designers, and QA testers, optimizing team efficiency and communication. • Provided weekly and on-demand reports to customer managers, highlighting project progress, identifying risks to critical paths, and proposing solutions.
Software Engineer at Quanta Computer Inc.
June 20, 2007 - March 7, 2010
• Developed customized Windows XP, and Win7 OS images, tailoring system configurations to meet specifications. • Managed bug lifecycle, from identification and analysis to resolution, ensuring stable OS performance. • Conducted functional, GUI, system, and regression testing, optimizing OS stability and usability. • Collaborated with hardware and software teams to enhance system compatibility with various devices. • Automated software installation and deployment processes, reducing setup time and improving efficiency.

Education

Master of Engineering at Carleton University
September 1, 2016 - April 27, 2018
Bachelor of Physics at Shandong University
September 1, 2003 - June 22, 2007
Computer Programming at Algonquin College
January 1, 2022 - December 22, 2023

Qualifications

Microsoft Certified: Fabric Data Engineer Associate
May 26, 2025 - May 26, 2026
AWS Certified Data Engineer – Associate
February 10, 2025 - February 10, 2028
Microsoft Certified: Power BI Data Analyst Associate
March 7, 2025 - March 7, 2026
Fundamentals of Agile Project Management
September 7, 2022 - November 7, 2030

Industry Experience

Government, Software & Internet, Education, Professional Services, Other

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert