JM

James Mills

Available to hire

I'm James Mills, a senior data engineer based in Austin, TX.

About

I’m James Mills, a senior data engineer based in Austin, TX. I design scalable data pipelines and cloud-native architectures using Spark, Kafka, Databricks, and AWS to enable fast, reliable analytics that drive business decisions. My work spans financial services, data lakes modernization, and real-time processing, always aiming for robust, governance-enabled data platforms.

Over the past 12+ years, I’ve led cross-functional teams, automated end-to-end data pipelines with Airflow and DevSecOps practices, and built resilient architectures that scale with business needs.

  • 3 years' experience
  • Joined November 2025

Industry experience

  • Financial Services
  • Software & Internet
  • Professional Services
  • Media & Entertainment
  • Other

Work experience· 4 roles

Lead Data Engineer · Capital OneAug 2022 – Nov 2025 · 3 yrs 4 mos

Designed and deployed robust data transformation pipelines on AWS using Spark and Airflow, enhancing scalability and optimizing data architecture for financial analytics. Directed the migration from legacy systems to modern data lakes with Docker and Kubernetes, ensuring efficient data pipeline architecture and streamlined deployment. Optimized pipeline performance by 40% through performance tuning and strategic caching interventions. Integrated DevSecOps practices into CI/CD pipelines, incorporating security scanning and compliance checks to safeguard data integrity.

Staff Data Engineer · SnowflakeJul 2022 – Jul 2022 · 1 mo

Engineered cloud data warehouses and comprehensive ETL pipelines, incorporating data model design to meet complex business requirements. Refactored legacy data applications into modular services, optimizing SQL queries and enhancing the performance of relational databases. Automated CI/CD pipelines with Jenkins and GitHub Actions, reducing deployment time by 50% and ensuring continuous delivery. Oversaw incident management and enforced data governance through vulnerability scanning, contributing to a reliable data infrastructure.

Senior Data Engineer · DatabricksMar 2019 – Mar 2019 · 1 mo

Architected enterprise-scale data modeling projects using Spark and Delta Lake, building a scalable data infrastructure to support actionable analytics. Automated data ingestion processes with Airflow, facilitating real-time processing and ensuring optimal extraction, transformation, and loading of data. Collaborated with cross-functional teams to design scalable data architecture on AWS and Azure, aligning with key business performance metrics. Implemented rigorous data quality testing protocols, reducing errors by 30% and reinforcing the reliability of the data pipeline.

Data Engineer · ClouderaJan 2016 – Jan 2016 · 1 mo

Education

Master of Business Administration (MBA) · New Jersey City University2030 – 2025

Hire James Mills today

Post a job and invite James, or contact them directly. No hidden commission.

Post a job