Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I'm Ey-Chih Chow, a senior software professional with 10+ years of experience designing large-scale systems and leading data, AI/ML, and analytics initiatives. I develop and deploy cloud-native AI/ML models, applications, and data products on AWS and Azure, delivering substantial business impact. I'm passionate about building robust data platforms and intelligent systems. My work spans Spark-based optimization, streaming architectures (Kinesis, Kafka), MV extensions, and agentic AI research, with a focus on practical, scalable solutions that empower product teams and customers.…I'm Ey-Chih Chow, a senior software professional with 10+ years of experience designing large-scale systems and leading data, AI/ML, and analytics initiatives. I develop and deploy cloud-native AI/ML models, applications, and data products on AWS and Azure, delivering substantial business impact. I'm passionate about building robust data platforms and intelligent systems. My work spans Spark-based optimization, streaming architectures (Kinesis, Kafka), MV extensions, and agentic AI research, with a focus on practical, scalable solutions that empower product teams and customers.

Ey-Chih Chow

Data Scientist, AI Engineer, Cloud Developer, +2





I'm Ey-Chih Chow, a senior software professional with 10+ years of experience designing large-scale systems and leading data, AI/ML, and analytics initiatives. I develop and deploy cloud-native AI/ML models, applications, and data products on AWS and Azure, delivering substantial business impact. I'm passionate about building robust data platforms and intelligent systems. My work spans Spark-based optimization, streaming architectures (Kinesis, Kafka), MV extensions, and agentic AI research, with a focus on practical, scalable solutions that empower product teams and customers.…I'm Ey-Chih Chow, a senior software professional with 10+ years of experience designing large-scale systems and leading data, AI/ML, and analytics initiatives. I develop and deploy cloud-native AI/ML models, applications, and data products on AWS and Azure, delivering substantial business impact. I'm passionate about building robust data platforms and intelligent systems. My work spans Spark-based optimization, streaming architectures (Kinesis, Kafka), MV extensions, and agentic AI research, with a focus on practical, scalable solutions that empower product teams and customers.

Available to hire

I’m Ey-Chih Chow, a senior software professional with 10+ years of experience designing large-scale systems and leading data, AI/ML, and analytics initiatives. I develop and deploy cloud-native AI/ML models, applications, and data products on AWS and Azure, delivering substantial business impact.

I’m passionate about building robust data platforms and intelligent systems. My work spans Spark-based optimization, streaming architectures (Kinesis, Kafka), MV extensions, and agentic AI research, with a focus on practical, scalable solutions that empower product teams and customers.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Language

English

Fluent

Work Experience

Engineering Lead for Vertical Engineering and Generative AI at Humana

January 1, 2021 - January 1, 2024

Led MLOps for deploying and retiring models to production in Azure-based environments (Databricks, ADF, ADLS). Implemented testing and validation practices for LLMs and generative AI. Built services to evaluate experiments and fine-tune pre-trained models (Hugging Face) for retrieval-augmented generation; explored performance improvements for knowledge-base reasoning in generative chatbots. Defined and executed a data & AI strategy and designed scalable AI models for vertical domains. Created a Qdrive ingestion pipeline exporting JSON from ASA to ADLS.

Senior Consulting for AWS Cloud Native Analytic Applications at Duke Energy

January 1, 2021 - January 1, 2021

Implemented Terraform infrastructure and Glue/Dynamic Frame code for moving data from on-prem/3rd-party sources to AWS S3/Redshift. Designed Lambda-based micro-batch upserts from S3 to Redshift. Refactored Step Functions for real-time ETL; configured API Gateway for Dynatrace data to S3. Created scalable materialized views using PySpark; leveraged Parquet, CloudWatch, Vault, Kafka, Concourse pipelines, and Qlik Replicate.

Senior Consulting for Ads Engineering at Apple Inc.

January 1, 2020 - January 1, 2021

Proposed and implemented parallel data extraction from 40+ Oracle tables to HDFS via Sqoop; designed monitoring and scheduling for large-scale ETL. Implemented alerting for 60+ Oracle Materialized Views using Apache Beam-based model on InfluxData. Developed ad spend generators for new data pipelines and proposed end-to-end exactly-once schemes for critical jobs.

Senior Consulting for Identity Platform on AWS at Intuit

January 1, 2019 - January 1, 2020

Architected backend store and GraphQL server using Delta Lake for transactional, exactly-once semantics with low latency. Implemented streaming ingestors (JSON to hierarchical entities) using Jolt; generated SQL for admin services and loaded to MySQL. Deployed production attributes via Kafka, Jenkins, and AWS services (EMR, EC2, Elasticsearch, DynamoDB).

Senior Consulting BI Platform Architect at Huawei Technologies

January 1, 2016 - January 1, 2019

Proposed and implemented Materialized View (MV) for SparkSQL to dramatically improve interactive BI performance. Extended SparkSQL Catalyst with Modular Plan and MV advisor. Enhanced MV maintenance using λ architecture, structured streaming, Delta tables, and a custom state store. Built a microservice in Dropwizard for clustering tables into fact/dimension structures using usage statistics.

Distinguised Engineer at ClearStoryData

January 1, 2015 - January 1, 2016

Architected Multi-Query Optimization (MQO) extension for SparkSQL to optimize cloud-based BI via in-memory caching and derived materialized datasets. Integrated MQO into Dropwizard as a Spark application, enabling query rewriting against summary datasets.

Principal Data Architect at PubMatic

January 1, 2013 - January 1, 2014

Led re-architecture of big data platform for ad insights, built an optimizer to fuse multiple Pig MapReduce jobs into single executions, and delivered Hive/Presto/Spark-based data platforms for reporting and ad targeting. Implemented log-to-Parquet pipelines and developed Presto OLAP queries with HyperLogLog-based analytics.

Lead Data Scientist: Product at Booyah

January 1, 2011 - January 1, 2013

Implemented Hadoop-based ETLT for event logs to Vertica; developed data products for e-commerce and user acquisition with ML techniques (Random Forest, Logistic Regression). Built predictive dashboards and a data platform for mobile gaming analytics, including large-scale ML with Mahout, and a SOA architecture with Memcached/HBase for game client access.

Senior Data Architect at Ngmoco

January 1, 2010 - January 1, 2011

Launched Hadoop MapReduce-based analytics platform for mobile social games. Built ETL for event processing and OLAP via MR-Cube; explored Protocol Buffers and Twitter’s Elephant Bird for serialization. Developed Java libraries for complex MapReduce jobs and demonstrated use of Pig for experimentation.

Technical Yahoo/Senior Software Architect at Yahoo! Inc.

January 1, 2008 - January 1, 2009

Designed stream mining techniques for real-time ad forecasting and network selection; added frequency capping; implemented event broadcasting to support ads training; developed a Perl-based Web Service API for 3rd party ad networks; enhanced cookie migration infrastructure for display ads.

Senior Consultant at Google Inc.

January 1, 2007 - January 1, 2008

Built a Recommendation System leveraging in-house search/ads tech; online learning for user behavior; applied relevancy analysis for query expansion; designed infrastructure to crawl and rank documents leveraging GFS, Bigtable, Sharding, and MapReduce.

Founder and Chief Architect / Senior Consultant at Accelerate Software

January 1, 2000 - January 1, 2007

Co-founded and led multiple data-centric ventures; built a high-performance, multi-threaded Java platform; implemented event-driven data delivery for structured, semi-structured, and unstructured data; developed web portal apps and SaaS CRM infrastructure; led data mining and optimization for online advertising.

Senior Architect for a Network Convergence Software at Western Technology Center, AT&T Laboratories

January 1, 1996 - January 1, 1997

Developed scalable event notification agents and high-performance data exchange mechanisms; built interoperable proxies for cross-storage access; implemented core network components using HTTP, sockets, and Java.

Chief Architect for SQLBase Query Optimizer at Gupta Technologies, Inc.

January 1, 1990 - January 1, 1994

Designed unified execution model, hybrid hash join with bit-map filtering, asynchronous prefetch, and comprehensive plan optimization techniques; implemented query rewrite and optimization strategies to improve performance.

Distinguished Engineer at ClearStoryData

January 1, 2015 - January 1, 2016

Architected Multi-Query Optimization (MQO) extension of SparkSQL to optimize analytical queries via in-memory caching and derived datasets; integrated MQO into a Dropwizard Spark application.

Senior Architect for Network Convergence Software at Western Technology Center, AT&T Laboratories

January 1, 1996 - January 1, 1997

Built scalable event notification and high-performance data exchange mechanisms; created interoperable proxy for cross-service data access.