Shiying Li
I’m Shiying Li, a Senior Data Engineer with 10+ years of experience designing and scaling secure, high-volume data platforms across fast-paced SaaS and healthcare environments.
About
I’m Shiying Li, a Senior Data Engineer with 10+ years of experience designing and scaling secure, high-volume data platforms across fast-paced SaaS and healthcare environments. I specialize in AWS-native lakehouse architectures using Databricks, Snowflake, Apache Iceberg, AWS Glue, and dbt, and I build robust batch and streaming pipelines with Kafka/MSK and Kinesis.
In my recent roles in UK/EU healthcare data, I’ve focused on GDPR/UK GDPR-aligned data governance and privacy controls, including regional data isolation, encryption, access auditing, and practical interoperability work using FHIR R4. I collaborate closely with product, clinical, and compliance teams to improve data quality, accelerate analytics, and deliver measurable impact—from real-time freshness improvements to faster analytics turnaround times.
- 10 years' experience
- Joined November 2026
Industry experience
- Healthcare
- Software & Internet
More experts in Bradford, United Kingdom
Work experience· 4 roles
Designed and scaled a HIPAA-compliant healthcare data lakehouse on S3, Lake Formation, Glue, Apache Iceberg, and Redshift to centralize EHR, clinical, claims, scheduling, and operational data for a unified patient view and population-health analytics. Built serverless, event-driven ingestion pipelines with Lambda, API Gateway, FHIR R4, DMS (CDC), and EventBridge to process API and CDC workloads and improve data freshness with high availability. Developed transformation layers using dbt, Redshift, SQL, PySpark, and GitHub Actions to create reusable star-schema and patient-centric data marts, reducing report generation time from hours to minutes. Implemented near-real-time pipelines with MSK/Kafka, Kinesis, Lambda, and EventBridge so downstream consumers could access encounters, results, claims, and patient events within minutes. Deployed automated data quality and anomaly detection with Great Expectations, CloudWatch, Glue, and Python to detect delays, duplicates, schema drift, and reco
Designed and scaled an AWS healthcare data platform using HealthLake, S3, Glue, Lake Formation, Apache Iceberg, and Athena to consolidate EHR, claims, laboratory, pharmacy, and clinical data into standardized longitudinal patient datasets. Architected regional data isolation and privacy controls with Lake Formation, IAM, KMS, CloudTrail, and S3 encryption to support least-privilege access, auditability, data residency, retention, and controlled processing for sensitive healthcare data. Built high-throughput ingestion pipelines (batch/API/CDC) using Airbyte, Lambda, API Gateway, DMS, EventBridge, and S3, improving freshness and traceability. Developed a FHIR R4 interoperability layer mapping proprietary schemas into standardized resources. Engineered distributed ETL with Spark/Glue for identity resolution, terminology mapping, deduplication, incremental processing, and late-arriving records. Implemented privacy-aware workflows (tokenization/pseudonymization/encryption) and built analyti
Extended Notion’s core data platform to support structured databases so underlying records could power tables, Kanban boards, calendar views, lists, galleries, and page-based views without duplicating source data. Designed flexible metadata and property models using PostgreSQL, SQL, JSON, UUIDs, and relational references to enable dynamic user-defined schemas. Built reusable query and transformation logic for consistent filtering, sorting, grouping, aggregation, and relational-property resolution across multiple views. Engineered relationship models with referential integrity for connecting records and supporting increasingly complex workspace structures. Optimized PostgreSQL indexes and query execution for large dataset views to improve interactive performance, and delivered schema migration/backfill workflows to introduce new properties without disrupting existing content.
Education
Hire Shiying Li today
Post a job and invite Shiying, or contact them directly. No hidden commission.




