James Mills
I'm James Mills, a senior data engineer based in Austin, TX.
About
I’m James Mills, a senior data engineer based in Austin, TX. I design scalable data pipelines and cloud-native architectures using Spark, Kafka, Databricks, and AWS to enable fast, reliable analytics that drive business decisions. My work spans financial services, data lakes modernization, and real-time processing, always aiming for robust, governance-enabled data platforms.
Over the past 12+ years, I’ve led cross-functional teams, automated end-to-end data pipelines with Airflow and DevSecOps practices, and built resilient architectures that scale with business needs.
- 3 years' experience
- Joined November 2025
Industry experience
- Financial Services
- Software & Internet
- Professional Services
- Media & Entertainment
- Other
Work experience· 4 roles
Designed and deployed robust data transformation pipelines on AWS using Spark and Airflow, enhancing scalability and optimizing data architecture for financial analytics. Directed the migration from legacy systems to modern data lakes with Docker and Kubernetes, ensuring efficient data pipeline architecture and streamlined deployment. Optimized pipeline performance by 40% through performance tuning and strategic caching interventions. Integrated DevSecOps practices into CI/CD pipelines, incorporating security scanning and compliance checks to safeguard data integrity.
Engineered cloud data warehouses and comprehensive ETL pipelines, incorporating data model design to meet complex business requirements. Refactored legacy data applications into modular services, optimizing SQL queries and enhancing the performance of relational databases. Automated CI/CD pipelines with Jenkins and GitHub Actions, reducing deployment time by 50% and ensuring continuous delivery. Oversaw incident management and enforced data governance through vulnerability scanning, contributing to a reliable data infrastructure.
Architected enterprise-scale data modeling projects using Spark and Delta Lake, building a scalable data infrastructure to support actionable analytics. Automated data ingestion processes with Airflow, facilitating real-time processing and ensuring optimal extraction, transformation, and loading of data. Collaborated with cross-functional teams to design scalable data architecture on AWS and Azure, aligning with key business performance metrics. Implemented rigorous data quality testing protocols, reducing errors by 30% and reinforcing the reliability of the data pipeline.
Education
Hire James Mills today
Post a job and invite James, or contact them directly. No hidden commission.







