AO

Hello! I'm a Staff Software Engineer with 10 years building production-grade platforms at the intersection of healthcare, fintech, and AI.

About

Hello! I’m a Staff Software Engineer with 10 years building production-grade platforms at the intersection of healthcare, fintech, and AI. I specialize in architecting distributed microservices, scalable APIs, and AI/ML-powered systems, with a track record of integrating LLMs, RAG pipelines, and agentic workflows into real-world products used by millions.

Beyond code, I strive to drive measurable business impact through engineering excellence and close collaboration with product, design, and data teams. I’m passionate about building accessible, reliable software and mentoring teams to reach their full potential.

  • 9 years' experience
  • Joined April 2026

Industry experience

  • Healthcare
  • Financial Services
  • Software & Internet
  • Professional Services
  • Media & Entertainment

Work experience· 7 roles

Staff Software Engineer · Hugging FaceJun 2022 – Present · 4 yrs 6 mos

Led end-to-end model inference dashboards with a Next.js/React frontend and FastAPI/Python backend, scaling to 500K+ daily inference requests across global edge deployments with a responsive UI and high-throughput API design. Architected and integrated RAG pipelines and agentic AI workflows into the Hugging Face Hub core platform using LangChain, LlamaIndex, and OpenAI/Anthropic APIs — enabling 2M+ developers to build production-grade LLM applications with 65% improved response accuracy and reduced hallucinations. Designed and optimized data pipelines and vector database solutions using PostgreSQL + pgvector and DynamoDB, powering AI-driven semantic search and recommendation engines; improved query throughput and reduced end-to-end latency through batching, indexing, and async ingestion strategies. Cut query latency by 45% by deploying optimized vector embeddings with Redis caching layers and async task queues (Kafka/RabbitMQ) for inference request fan-out, ensuring consistent perfor

Staff Software Engineer — Hugging Face Hub · Hugging FaceJun 2022 – Present · 4 yrs 6 mos

Built end-to-end model inference dashboards with a Next.js/React frontend and FastAPI/Python backend, scaling to 500K+ daily inference requests across global edge deployments with a responsive UI and high-throughput API design. Architected and integrated RAG pipelines and agentic AI workflows into the core platform using LangChain, LlamaIndex, and OpenAI/Anthropic APIs, enabling 2M+ developers to build production-grade LLM applications with improved accuracy and reduced hallucinations. Designed and optimized data pipelines and vector database solutions (PostgreSQL + pgvector, DynamoDB) powering AI-driven semantic search and recommendations; improved query throughput and latency via batching, indexing, and async ingestion. Cut query latency by 45% by deploying optimized vector embeddings with Redis caching layers and async task queues for inference fan-out. Led migration to domain-driven microservices on AWS EKS + Bedrock, increasing deployment frequency and ensuring fault isolation. Ow

Senior Software Engineer · CVS HealthMar 2019 – May 2022 · 3 yrs 3 mos

Spearheaded full-stack development of MinuteClinic Digital Tools (Clinic Scheduling & Virtual Care), a scalable platform connecting patients with in-clinic and virtual healthcare, driving a 25% increase in online appointments and significantly improving patient engagement. Integrated AI/ML capabilities for predictive patient engagement and personalized healthcare recommendations using Python, TensorFlow, and Databricks; architected backend microservices using Java, Spring Boot, Node.js, REST/GraphQL, and integrated with Epic EHR, Redis, RabbitMQ/Kafka, ensuring secure real-time patient data access at scale. Designed robust data pipelines using PostgreSQL, DynamoDB, and ETL workflows, improving query performance by 30% under high-load conditions and enabling reliable analytics and reporting. Reduced system latency by 40% through asynchronous processing, intelligent caching strategies, and message queue architecture, ensuring scalability during peak traffic periods. Led cloud-native arch

Senior Software Engineer — MinuteClinic Digital · CVS HealthMar 2019 – May 2022 · 3 yrs 3 mos
Software Engineer · Robinhood GoldOct 2016 – Feb 2019 · 2 yrs 5 mos
Software Engineer · RobinhoodOct 2016 – Feb 2019 · 2 yrs 5 mos
Software Engineer — Robinhood Gold · RobinhoodOct 2016 – Feb 2019 · 2 yrs 5 mos

Education

Bachelor of Science in Computer Science · Georgia Institute of Technology2012 – 2016
Bachelor of Science · Georgia Institute of Technology2012 – 2016
Bachelor of Science · Georgia Institute of Technology2012 – 2016
Bachelor of Science in Computer Science · Georgia Institute of Technology2012 – 2016

Hire Andrew Osborn today

Post a job and invite Andrew, or contact them directly. No hidden commission.

Post a job