Venkata Deepak Reddy Penubaka
I’m an AI/ML Engineer with 5+ years of experience building and scaling production-grade AI systems, especially across Generative AI, Agentic AI, and Large Language Models (LLMs).
About
I’m an AI/ML Engineer with 5+ years of experience building and scaling production-grade AI systems, especially across Generative AI, Agentic AI, and Large Language Models (LLMs). I enjoy taking end-to-end ownership—from designing agentic workflows (planning, retrieval, and tool execution) to deploying distributed inference pipelines that perform reliably under real traffic.
In my recent work at Meta, I’ve built agent orchestration and evaluation frameworks that improve quality and consistency while reducing latency and inference costs. Earlier at HCL Tech, I delivered NLP and GenAI solutions for enterprise use cases and strengthened the full MLOps lifecycle using Kubernetes, MLflow, and automated retraining. I’m focused on turning advanced research ideas into dependable, cloud-native products that help large user bases succeed faster.
- 5 years' experience
- Joined September 2026
Industry experience
- Software & Internet
- Professional Services
- Computers & Electronics
More experts in San Francisco, United States
- AI Developers for hire in San Francisco, United States
- AI Engineers for hire in San Francisco, United States
- AI Evaluators for hire in San Francisco, United States
- Data Engineers for hire in San Francisco, United States
- Data Scientists for hire in San Francisco, United States
- DevOps Developers for hire in San Francisco, United States
- Software Engineers for hire in San Francisco, United States
Work experience
Developed Python-based agentic AI workflows integrating reasoning, planning, retrieval, and tool execution for complex multi-step tasks. Built distributed inference pipelines using PyTorch, vector retrieval, and memory systems to improve response accuracy and task execution success rates. Optimized serving architecture with intelligent caching, batching, and retrieval augmentation to reduce inference costs and end-to-end latency. Engineered RAG and tool-calling services supporting scalable reasoning and autonomous decision-making, and designed agent orchestration with LangGraph/LangChain/FastAPI for memory management and long-horizon planning. Implemented LLM evaluation frameworks with benchmark testing and hallucination detection, including automated quality scoring. Also built supporting microservices with Java/Spring Boot, Kafka, Redis, and PostgreSQL, deployed on Kubernetes with Docker/Helm and CI/CD. Architected distributed data pipelines with Spark/Ray/Kafka and delivered monitor
Built Python-based ML pipelines for structured and unstructured enterprise data powering predictive analytics and AI-driven decision-making used by business teams globally. Developed NLP and Generative AI solutions with Transformer models in PyTorch to improve document understanding and response accuracy for customer support/knowledge management. Delivered MLOps workflows with MLflow, Kubernetes, and automated retraining to reduce deployment cycles while improving reliability. Implemented scalable training and experimentation frameworks using TensorFlow/PyTorch/Databricks and feature engineering to improve accuracy. Created REST microservices to serve AI predictions at scale, reducing inference latency. Architected cloud-native deployments on AWS using SageMaker, S3, and EKS with monitoring and governance, and built distributed data processing pipelines with Spark/Databricks/Kafka. Deployed containerized AI services with Docker/Kubernetes and CI/CD to improve scalability and reduce inf
Education· 8
Certifications and awards· 8
Hire Venkata Deepak Reddy Penubaka today
Post a job and invite Venkata, or contact them directly. No hidden commission.







