Available to hire
Hi, I’m Rahul Hatkar, an AI/ML Engineer based in San Francisco who specializes in building production-grade AI systems, agents, and retrieval-augmented generation pipelines. I translate research and experimentation into scalable, enterprise-ready solutions that improve model quality, reliability, and operational efficiency.
I thrive in cross-functional teams and have a track record of delivering end-to-end AI platforms on AWS and Kubernetes, driving measurable gains in accuracy, latency, and cost savings across large-scale deployments.
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Work Experience
AI/ML Engineer at Databricks
March 1, 2025 - PresentDesigned and deployed Python-based enterprise AI agent workflows leveraging MLflow, Mosaic AI Agent Framework, Vector Search, and Delta Lake. Led RAG optimization, embedding tuning, and automated evaluation pipelines, boosting response accuracy by 22% and cutting inference cost by 31%. Reduced end-to-end latency by 38% through retrieval optimization, vector indexing improvements, asynchronous processing, and scalable serving pipelines. Built agent evaluation frameworks (LLM-as-a-Judge) for groundedness and tool accuracy. Engineered scalable retrieval-augmented generation pipelines and cloud-native microservices on AWS using Docker, Kubernetes, and Databricks Model Serving. Implemented automated MLOps pipelines with MLflow, Delta Lake, and CI/CD, enabling governance and high-scale operations.
AI/ML Engineer at Anthropic
March 1, 2024 - February 28, 2025Developed Python-based distributed evaluation pipelines processing over 2 million benchmark runs monthly, improving model accuracy by 18% on coding and reasoning tasks. Built automated safety and agentic evaluation frameworks, reducing validation cycles by 42% and supporting frontier AI deployment. Created synthetic data generation and quality-filtering workflows increasing benchmark coverage by 35%. Built ML pipelines with PyTorch, JAX, and Ray for large-scale experimentation; implemented RL and preference optimization workflows. Developed end-to-end evaluation services with Python, REST APIs, PostgreSQL, and containerized workloads. Architected microservices-based evaluation platforms on Kubernetes, AWS EKS, and cloud-native data processing on S3/Lambda/Batch. Implemented observability via Prometheus, Grafana, and OpenTelemetry, reducing incidents and improving reliability. Optimized serving infrastructure to support 500k+ monthly users with cost reductions.
Machine Learning Engineer at Accenture
June 1, 2019 - February 28, 2023Delivered end-to-end ML pipelines using Python, PySpark, Scikit-Learn, and MLflow for 2.5M+ users, boosting prediction accuracy by 12%. Built feature stores and automated retraining to reduce latency by 28% and accelerate deployment. Implemented scalable data processing with Databricks, Spark, Kafka, Snowflake for real-time analytics across multiple domains. Designed cloud-native AI solutions on AWS (S3, EMR, Lambda, SageMaker) and Terraform; built microservices-based inference with FastAPI, Docker, Kubernetes, Redis. Automated CI/CD and MLOps using AWS, GitHub Actions, Jenkins, Airflow, MLflow Registry and CloudWatch. Developed enterprise data lake/lakehouse with Delta Lake and Spark to support batch and streaming analytics.
Education
Master of Science in Information Technology and Management at Webster University
January 11, 2030 - June 29, 2026Qualifications
Databricks Certified Generative AI Engineer Associate
January 11, 2030 - June 29, 2026AWS Certified Machine Learning Engineer – Associate
January 11, 2030 - June 29, 2026Microsoft Certified: Azure AI Engineer Associate (AI-102)
January 11, 2030 - June 29, 2026Industry Experience
Software & Internet, Professional Services
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Hire a AI Engineer
We have the best ai engineer experts on Twine. Hire a ai engineer in San Francisco today.