I am a Senior Data Engineer with 12+ years of experience building production systems that automate complex engineering workflows and maintain high reliability at scale. I design and support data-intensive pipelines, dashboards, and robust automation across cloud platforms. My recent work centers on AI-assisted engineering infrastructure, including vector metadata catalogs, embeddings-backed retrieval, CI/CD automation, and production-grade observability for model-assisted pipelines. I work hands-on with LLM APIs, prompt orchestration, tool calling, and code-review automation to generate and validate PRs, tests, and release summaries while enforcing approval and audit controls. I enjoy building integrations across GitHub, ticketing systems, CI, and deployment tooling, implementing permission models, audit logs, rollback procedures, and benchmark suites. I am focused on delivering agent-driven automation that engineers can trust in production.

Matthew Chow

I am a Senior Data Engineer with 12+ years of experience building production systems that automate complex engineering workflows and maintain high reliability at scale. I design and support data-intensive pipelines, dashboards, and robust automation across cloud platforms. My recent work centers on AI-assisted engineering infrastructure, including vector metadata catalogs, embeddings-backed retrieval, CI/CD automation, and production-grade observability for model-assisted pipelines. I work hands-on with LLM APIs, prompt orchestration, tool calling, and code-review automation to generate and validate PRs, tests, and release summaries while enforcing approval and audit controls. I enjoy building integrations across GitHub, ticketing systems, CI, and deployment tooling, implementing permission models, audit logs, rollback procedures, and benchmark suites. I am focused on delivering agent-driven automation that engineers can trust in production.

Available to hire

I am a Senior Data Engineer with 12+ years of experience building production systems that automate complex engineering workflows and maintain high reliability at scale. I design and support data-intensive pipelines, dashboards, and robust automation across cloud platforms.

My recent work centers on AI-assisted engineering infrastructure, including vector metadata catalogs, embeddings-backed retrieval, CI/CD automation, and production-grade observability for model-assisted pipelines. I work hands-on with LLM APIs, prompt orchestration, tool calling, and code-review automation to generate and validate PRs, tests, and release summaries while enforcing approval and audit controls. I enjoy building integrations across GitHub, ticketing systems, CI, and deployment tooling, implementing permission models, audit logs, rollback procedures, and benchmark suites. I am focused on delivering agent-driven automation that engineers can trust in production.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
See more

Work Experience

Data Architect at Alegion
April 1, 2024 - April 1, 2026
Designed and shipped an embeddings-backed vector metadata catalog and retrieval layer (ChromaDB, Milvus) to enable codebase- and asset-aware retrieval for downstream agent workflows, improving developer search relevance by 60%. Built private agent prototypes that generate and open context-aware pull requests using OpenAI and Hugging Face APIs, with prompt orchestration and tool calling to run static checks and unit tests before PR creation. Implemented production approval states, audit logging, and RBAC hooks for agent-driven changes integrated with GitHub and Okta, introducing explicit approval gating for sensitive repo paths. Architected CI/CD automation using GitHub Actions and Terraform to deploy agent components and reversible releases, with evaluation hooks that run benchmark suites and automatic rollback on regressions. Optimized cloud infrastructure for model serving and retrieval (AWS SageMaker, Lambda, S3) and reduced inference latencies by 25% through caching and embedding q
Senior Data Engineer at Loop
July 1, 2021 - March 1, 2024
Built automation that translated engineering workflows into reliable, observable pipelines: automated changelists, release notes, rollback procedures, and post-deploy validation checks. Developed a CI/CD-integrated code review automation flow using GitHub Apps and GitHub Actions that added automated linting, static analysis (custom rules), and test generation before merge. Implemented a codebase-aware retrieval service using Pinecone and LlamaIndex to feed contextual snippets to generation agents, improving automated PR relevance and reducing manual edits by 35%. Designed prompt orchestration and task planning layers (Python/TypeScript) to break complex change requests into safe, reviewable steps and to request human approvals for high-risk paths. Added audit logging and evaluation tooling to track agent decisions and generate human-readable explanations of risk and change rationale for reviewers. Led cross-functional pilots with engineers to tune agent behavior and acceptance criteria
Data Engineer at MOS Hanford
July 1, 2017 - June 1, 2021
Built scalable ETL and feature-store systems and introduced automated validation suites that gate production deployments and validate data integrity post-release. Redesigned transactional and deployment workflows to support safe rollbacks and staged releases, reducing incident recovery time by 40%. Implemented centralized logging, audit trails, and monitoring (ELK, Prometheus) to support forensic analysis of automated changes and pipeline failures. Developed data-masking and encryption layers and integrated role-based access controls to protect sensitive paths touched by automation. Authored technical documentation and runbooks for on-call responses, agent failure modes, and manual approval procedures used during agent rollouts.
Software Engineer at Paystand
September 1, 2014 - July 1, 2017
Developed backend services and automation for payment settlement pipelines, including CI-driven test suites and regression checks that reduced deployment errors by 30%. Integrated OAuth2-based RBAC and service-to-service authentication to secure automated agents and internal tooling. Built automated regression and integration tests for critical services and added pre-merge validation steps to the CI workflow. Collaborated with product and engineering teams to design audit-friendly automation that surfaces change rationale and risk summaries for reviewers.

Education

Bachelor of Science in Computer Engineering at University of California, Davis
January 1, 2008 - January 1, 2014

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Professional Services