I'm Hemanth Konda, a Senior AI / ML Engineer with about 9 years of hands-on experience designing, building, and operating production ML and AI systems across healthcare, pharmaceuticals, and capital markets. Over the last three years I’ve focused on large language models, retrieval augmented generation, and agentic AI workflows, currently leading engineering for an MCP-based agent platform at Goldman Sachs. I’ve built end-to-end ML platforms, RAG pipelines, and agentic systems with strong emphasis on safety, governance, and cost efficiency. I thrive in cross-functional environments, collaborating with product managers, clinical SMEs, quants, security and compliance teams to deliver scalable, auditable AI solutions that meet regulatory requirements and business goals.

Hemanth Konda

I'm Hemanth Konda, a Senior AI / ML Engineer with about 9 years of hands-on experience designing, building, and operating production ML and AI systems across healthcare, pharmaceuticals, and capital markets. Over the last three years I’ve focused on large language models, retrieval augmented generation, and agentic AI workflows, currently leading engineering for an MCP-based agent platform at Goldman Sachs. I’ve built end-to-end ML platforms, RAG pipelines, and agentic systems with strong emphasis on safety, governance, and cost efficiency. I thrive in cross-functional environments, collaborating with product managers, clinical SMEs, quants, security and compliance teams to deliver scalable, auditable AI solutions that meet regulatory requirements and business goals.

Available to hire

I’m Hemanth Konda, a Senior AI / ML Engineer with about 9 years of hands-on experience designing, building, and operating production ML and AI systems across healthcare, pharmaceuticals, and capital markets. Over the last three years I’ve focused on large language models, retrieval augmented generation, and agentic AI workflows, currently leading engineering for an MCP-based agent platform at Goldman Sachs. I’ve built end-to-end ML platforms, RAG pipelines, and agentic systems with strong emphasis on safety, governance, and cost efficiency.

I thrive in cross-functional environments, collaborating with product managers, clinical SMEs, quants, security and compliance teams to deliver scalable, auditable AI solutions that meet regulatory requirements and business goals.

See more

Experience Level

Expert
Expert
Expert
Expert
Intermediate

Language

English
Fluent

Work Experience

Senior AI / ML Engineer at Goldman Sachs
January 1, 2025 - Present
Led six MCP servers exposing internal capabilities to LLM agents (e.g., filings retrieval, transcript search, fundamentals, peer comparison, chart data, research archive search). Built the MCP host to broker tool calls, enforce per-analyst rate limits, and emit audit logs for compliance. Designed LangGraph orchestrator that decomposes queries into retrieval, computation, and synthesis steps with deterministic checkpoints. Fine-tuned bge embeddings for retrieval, implemented hybrid BM25 + dense retrieval with reranking, and deployed on EKS with Bedrock Claude inference. Built PII/PII- NSFW scrubbing and robust monitoring across latency, cost, and quality. Partnered with model risk management on SR 11 7 aligned documentation and ran internal code/regression evaluations before production promotions.
Senior AI / ML Engineer at Eli Lilly and Company
March 1, 2023 - December 1, 2024
Built Lilly’s Gen AI gateway routing prompts to GPT-4 Turbo (Azure OpenAI), Llama 3 on Bedrock, and self-hosted Mistral 7B. Implemented a two-stage adverse event extraction pipeline (BioBERT NER with GPT-4 Turbo verification) and a RAG-based literature review assistant. Deployed Mistral 7B on Bedrock and SageMaker for latency-sensitive tasks, established an evaluation framework (Ragas, TruLens) and gated changes behind passing evaluation runs. Implemented guardrails to block PHI leakage and unsafe medical advice, and created annotation tooling for medical reviewers with active learning loops.
Senior ML Engineer at Elevance Health
January 1, 2022 - January 1, 2023
Built the central ML platform on AWS SageMaker, including a feature store, CI/CD pipelines, and monitoring. Implemented drift and performance monitoring with Evidently AI, and built batch/real-time deployments. Migrated legacy SageMaker pipelines to standardized templates using Step Functions and Feature Store. Collaborated with HIPAA security teams to design IAM, VPC endpoints, KMS integration, and audit logging; produced model lifecycle playbooks and governance documentation.
ML Engineer at UnitedHealth Group (Optum)
March 1, 2020 - December 31, 2021
Built batch ML pipelines on Azure Databricks and Azure ML for utilization, risk scoring, and care management. Implemented hospital readmission risk and high-cost claimant models, Delta Lake-backed data pipelines, and a productionized model registry with automated drift checks. Led CI/CD via CodePipeline/CodeBuild, and contributed to on-call incident response with runbooks.
Data Analyst progressing to Junior ML Engineer at CARE Hospitals
April 1, 2017 - January 1, 2020
Built SQL-based data marts consolidating admissions, discharges, labs, and billing for analytics. Developed early ML models for readmission risk and length of stay; migrated workloads to AWS, implemented scheduled ETL, and delivered dashboards for hospital administration. Automated data quality checks, documented data definitions, and mentored junior analysts on Python and ML basics.

Education

Bachelor of Engineering, Computer Science and Engineering at GITAM Deemed University, Hyderabad, India
January 11, 2030 - January 1, 2017

Qualifications

Add your qualifications or awards here.

Industry Experience

Healthcare, Life Sciences, Financial Services, Professional Services, Other