I’m an AI Software Engineer who builds production-grade LLM and agentic systems for real-world workflows, from large-scale document understanding in healthcare to fast, reliable customer onboarding and support automation. I’ve engineered evaluation pipelines, guardrails, and observability so these systems can be shipped, monitored, and improved with confidence. I enjoy turning complex requirements into scalable software—designing end-to-end pipelines, microservices, and real-time experiences using modern tools like vLLM, LangGraph, Temporal, AWS, and React. Beyond engineering, I’ve also founded and shipped products and research prototypes, including multimodal assistants for multi-step tasks, and I like collaborating closely to deliver measurable outcomes like reduced latency, cost, and operational friction.…

Jianxiang Gao

I’m an AI Software Engineer who builds production-grade LLM and agentic systems for real-world workflows, from large-scale document understanding in healthcare to fast, reliable customer onboarding and support automation. I’ve engineered evaluation pipelines, guardrails, and observability so these systems can be shipped, monitored, and improved with confidence. I enjoy turning complex requirements into scalable software—designing end-to-end pipelines, microservices, and real-time experiences using modern tools like vLLM, LangGraph, Temporal, AWS, and React. Beyond engineering, I’ve also founded and shipped products and research prototypes, including multimodal assistants for multi-step tasks, and I like collaborating closely to deliver measurable outcomes like reduced latency, cost, and operational friction.…

Available to hire

I’m an AI Software Engineer who builds production-grade LLM and agentic systems for real-world workflows, from large-scale document understanding in healthcare to fast, reliable customer onboarding and support automation. I’ve engineered evaluation pipelines, guardrails, and observability so these systems can be shipped, monitored, and improved with confidence.

I enjoy turning complex requirements into scalable software—designing end-to-end pipelines, microservices, and real-time experiences using modern tools like vLLM, LangGraph, Temporal, AWS, and React. Beyond engineering, I’ve also founded and shipped products and research prototypes, including multimodal assistants for multi-step tasks, and I like collaborating closely to deliver measurable outcomes like reduced latency, cost, and operational friction.

See more

Language

Javanese
Intermediate

Work Experience

AI Software Engineer II at Brellium
June 1, 2025 - June 30, 2026
Engineered an LLM-based document audit platform processing ~1% of U.S. patient medical records, building a generalized clinical document processing pipeline with 99.99%+ extraction accuracy and reducing manual implementation time by 90%. Designed marker-based learning to reduce parsing cost/latency while improving accuracy. Built agentic onboarding and support workflows using Next.js and Temporal (90% faster ticket resolution, 75% lower engineering overhead). Developed an internal coding agent saving 80%+ engineering time and reducing customer support cycle from 3 weeks to 1 day. Architected AI evaluation pipelines with prompt version management and agentic workflow observability, improving overall system performance by 30%.
Research Software Engineer, Alexa Prize TaskBot Challenge at Penn State NLP Lab
January 1, 2023 - August 31, 2023
Selected as 1 of 10 global teams for Amazon Alexa Prize TaskBot Challenge 2; built an LLM-powered multimodal voice-and-vision task assistant using Llama and CLIP to guide users through multi-step tasks on Echo devices. Designed an agent backend with microservices on Amazon ASK API and EC2, using GPU Docker, caching, ECS load balancing, and auto-scaling to support a 50M+ user base and cut operational latency by 50% under heavy load. Developed a graph-based conversational framework and a hybrid safety alignment system, reducing conversation friction and increasing user response rate by 30%. Analyzed production logs to debug and fix backend service issues, communicating findings directly with Amazon engineers.
Software Engineer at Stonk Tech Inc.
January 1, 2022 - April 30, 2024
Led end-to-end development of three production systems—a video-processing microservice, a financial AI chatbot, and an admin panel—each shipped independently on AWS. Built a video query and ranking system using vector databases on a scalable AWS pipeline (S3, Textract, CloudFront, Lightsail, MySQL), improving search relevance/performance by 55%. Engineered a financial chatbot with LangGraph, GPT models, and Ray, improving retention and engagement by 30%. Designed and built an admin panel with React/TypeScript/Ant Design Pro and Flask, reducing administrative cost by 68%.
NLP Engineer at Penn State Nittany AI Alliance
August 1, 2021 - July 31, 2023
Built SmartOCR, an information extraction pipeline for high school transcripts using AWS Textract, S3, and spaCy NER, achieving 95%+ accuracy for admissions processing fields such as courses, grades, and credits.
NLP Engineer, Product Development at Johnson & Johnson
July 1, 2021 - October 31, 2021
Integrated AWS, GCP, and Tesseract OCR services into existing document workflows, improving OCR accuracy by 10%, and ran field engineering tests on algorithm performance.
Founder at Briefly
February 1, 2021 - August 31, 2021
Founded and led a 7-person team building a knowledge management platform for remote learning; built the React/Redux frontend and Django/Celery backend and shipped transformer-based (BERT, T5, GPT-3) summarization, quiz generation, and a Q&A chatbot on AWS.

Education

M.S. Computer Science (AI) at University of Southern California
August 1, 2023 - May 31, 2025
B.S. Computer Science at Pennsylvania State University, Schreyer Honors College
August 1, 2019 - May 31, 2023

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Healthcare, Education, Professional Services