Hi, I’m Bharani Kumar Yerraballi, an AI Software Engineer with 5+ years of experience building and delivering ML and LLM-based solutions powering production systems. I’m proficient in Python backend services, NLP, transformer models, and Retrieval-Augmented Generation (RAG) to support data-driven applications. I also work across MLOps, including model versioning, automated retraining, monitoring, and performance tracking, and I enjoy integrating AI models into enterprise platforms via REST APIs, asynchronous processing, Docker, and Kubernetes. I collaborate closely with product, data, and engineering teams to turn requirements into reliable, scalable solutions. In my roles at Optum and Hexaware, I’ve delivered secure, compliant AI solutions for healthcare and enterprise contexts, with a strong emphasis on responsible AI and operational excellence.

Bharani Kumar Yerraballi

Hi, I’m Bharani Kumar Yerraballi, an AI Software Engineer with 5+ years of experience building and delivering ML and LLM-based solutions powering production systems. I’m proficient in Python backend services, NLP, transformer models, and Retrieval-Augmented Generation (RAG) to support data-driven applications. I also work across MLOps, including model versioning, automated retraining, monitoring, and performance tracking, and I enjoy integrating AI models into enterprise platforms via REST APIs, asynchronous processing, Docker, and Kubernetes. I collaborate closely with product, data, and engineering teams to turn requirements into reliable, scalable solutions. In my roles at Optum and Hexaware, I’ve delivered secure, compliant AI solutions for healthcare and enterprise contexts, with a strong emphasis on responsible AI and operational excellence.

Available to hire

Hi, I’m Bharani Kumar Yerraballi, an AI Software Engineer with 5+ years of experience building and delivering ML and LLM-based solutions powering production systems. I’m proficient in Python backend services, NLP, transformer models, and Retrieval-Augmented Generation (RAG) to support data-driven applications. I also work across MLOps, including model versioning, automated retraining, monitoring, and performance tracking, and I enjoy integrating AI models into enterprise platforms via REST APIs, asynchronous processing, Docker, and Kubernetes. I collaborate closely with product, data, and engineering teams to turn requirements into reliable, scalable solutions.

In my roles at Optum and Hexaware, I’ve delivered secure, compliant AI solutions for healthcare and enterprise contexts, with a strong emphasis on responsible AI and operational excellence.

See more

Work Experience

AI Software Engineer at Optum
December 1, 2024 - Present
Designed, trained, and deployed machine learning and NLP models to support healthcare operations, improving the accuracy of clinical and operational predictions across large-scale patient and claims datasets. Built and productionized LLM-based applications using Retrieval-Augmented Generation (RAG) for secure healthcare data access, integrating vector databases and prompt pipelines to support clinical and business workflows. Developed backend services in Python to integrate AI models into enterprise systems, ensuring low-latency inference, high availability, and seamless interaction with internal APIs and downstream applications. Implemented end-to-end MLOps pipelines including data ingestion, model versioning with MLflow, automated retraining, and monitoring for performance drift in regulated healthcare environments. Collaborated with Responsible AI and compliance teams to validate model behavior, reduce bias, and meet HIPAA and governance standards for AI usage in clinical and pharma
AI / ML Engineer at Hexaware Technologies
August 1, 2021 - July 1, 2023
Developed and deployed language-model–based solutions that automated multi-step business tasks, reducing manual processing across document-driven workflows. Fine-tuned transformer models with domain-specific datasets and prompt optimization techniques, improving response relevance and task accuracy by 18–22% in healthcare and retail. Built end-to-end ML and LLM deployment pipelines using Docker, Kubernetes, and cloud ML services, enabling faster model releases and reducing deployment turnaround time by nearly 25%. Integrated AI services with existing enterprise systems through REST APIs and asynchronous workflows, supporting real-time data exchange without disrupting legacy application performance. Applied responsible AI practices by conducting bias checks, access controls, and data validation steps, helping teams meet internal compliance and security standards during production rollouts. Worked closely with product managers, data engineers, and QA teams to translate business requi
Software Developer at Adons Softech
May 1, 2019 - July 1, 2021
Built and supported web applications using JavaScript, PHP, HTML, and CSS, contributing to features used by multiple client teams and supporting applications with a few thousand monthly active users. Worked on backend logic and MySQL databases, writing and optimizing SQL queries that reduced data retrieval time by around 20% for frequently used screens. Coordinated with designers and project managers to understand requirements, clarify changes, and deliver features within sprint timelines across 6–8 active client projects. Identified and fixed bugs through unit testing and debugging, helping reduce production issues by ~25% over successive release cycles. Improved modules by cleaning legacy code and optimizing front-end components, resulting in faster page loads and smoother user interactions. Prepared technical documentation for application workflows, database structures, and deployment steps, helping new team members ramp up faster and reducing dependency on senior developers.

Education

Masters in Computer Science and Information Systems at Saint Leo University
January 11, 2030 - May 1, 2025

Qualifications

Java Certified Foundations Associate
January 11, 2030 - February 24, 2026
AWS Certified Solutions Architect
January 11, 2030 - February 24, 2026

Industry Experience

Healthcare, Software & Internet, Professional Services, Financial Services