Hello, I’m Rahul Talari, an AI/ML engineer with 10+ years designing, deploying, and operating production-grade AI, ML, and LLM systems, with deep expertise in agentic AI, prompt engineering, and end-to-end AI/ML platform development. I have a strong background in building CI/CD pipelines, MLOps and DevOps workflows, and infrastructure-as-code to support secure, compliant, and highly scalable AI deployments across Azure, AWS, and GCP. I have delivered AI and machine learning solutions in regulated environments, including healthcare and digital health, with emphasis on security, compliance, observability, and operational reliability. I’m a hands-on engineer skilled in APIs, data platforms, and cloud infrastructure, focused on integrating ML models and LLM-powered systems into enterprise software using modern MLOps and DevOps practices.

Hello, I’m Rahul Talari, an AI/ML engineer with 10+ years designing, deploying, and operating production-grade AI, ML, and LLM systems, with deep expertise in agentic AI, prompt engineering, and end-to-end AI/ML platform development. I have a strong background in building CI/CD pipelines, MLOps and DevOps workflows, and infrastructure-as-code to support secure, compliant, and highly scalable AI deployments across Azure, AWS, and GCP. I have delivered AI and machine learning solutions in regulated environments, including healthcare and digital health, with emphasis on security, compliance, observability, and operational reliability. I’m a hands-on engineer skilled in APIs, data platforms, and cloud infrastructure, focused on integrating ML models and LLM-powered systems into enterprise software using modern MLOps and DevOps practices.

Available to hire

Hello, I’m Rahul Talari, an AI/ML engineer with 10+ years designing, deploying, and operating production-grade AI, ML, and LLM systems, with deep expertise in agentic AI, prompt engineering, and end-to-end AI/ML platform development. I have a strong background in building CI/CD pipelines, MLOps and DevOps workflows, and infrastructure-as-code to support secure, compliant, and highly scalable AI deployments across Azure, AWS, and GCP.

I have delivered AI and machine learning solutions in regulated environments, including healthcare and digital health, with emphasis on security, compliance, observability, and operational reliability. I’m a hands-on engineer skilled in APIs, data platforms, and cloud infrastructure, focused on integrating ML models and LLM-powered systems into enterprise software using modern MLOps and DevOps practices.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
See more

Language

English
Fluent
Javanese
Advanced
Bashkir
Advanced

Work Experience

Senior Full Stack Engineer / Tech Lead at DataScan LP
November 1, 2019 - November 25, 2025
Designed and scaled microservices and serverless applications using Golang, Python, and Spring Boot, improving system scalability and response times by 40%. Built and optimized RESTful and GraphQL APIs supporting large-scale inventory management and analytics systems. Integrated RFID and barcode-based tracking with real-time analytics, boosting operational accuracy and reducing manual reconciliation errors by 35%. Modernized legacy monolith into a containerized Kubernetes ecosystem (AWS EKS + Azure AKS), cutting deployment time from 45 minutes to 10 minutes. Engineered CI/CD pipelines with Jenkins and GitLab CI, achieving 95% automated deployment coverage and consistent release cadence. Implemented FastAPI-based data services with sync I/O for high-throughput operations, reducing average API latency by 50%. Developed SaaS analytics modules using SAS integrated with Golang microservices for real-time reporting and data-driven decision making. Enhanced reliability and observability throu
Senior Backend Developer at DigitalIQ, Inc
October 1, 2019 - October 1, 2019
Designed and implemented REST and gRPC APIs for fintech products handling high-volume, secure transactions. Architected a microservices platform improving modularity, fault tolerance, and release agility across financial services. Delivered fraud-detection pipelines using Go, Spark, and Cassandra to detect anomalies in real time and reduce false positives by 23%. Built and deployed payment gateway microservices using OAuth 2.0 and SSL/TLS, ensuring PCI DSS compliance. Optimized data pipelines and caching with Redis and PostgreSQL, lowering database load by 40%. Created and maintained CI/CD pipelines (Jenkins, GitLab CI) and containerized workflows with Docker and Kubernetes. Collaborated cross-functionally with frontend, QA, and product teams under Agile Scrum to deliver features on time.
Full Stack Developer at Tempo AI
February 1, 2018 - February 1, 2018
Built RESTful APIs and multi-server applications using Golang and Python (Django, Flask) to support health-care data platforms. Developed Spring Boot microservices for secure data exchange in HIPAA-compliant environments. Created Angular 8 front-end applications leveraging Ivy Renderer and differential loading for improved UX and cross-browser support. Contributed to patient portals and EHR integration, enabling real-time health record access for providers and patients. Implemented test automation and continuous integration practices for backend and UI services. Maintained detailed system documentation and collaborated across teams to support long-term scalability and maintainability.
AI & Full Stack Engineer at Tempus AI
May 1, 2016 - February 28, 2018
Developed AI-enabled health care platforms supporting large-scale clinical data processing; built HIPAA-compliant data services for secure ingestion and processing of health care records; backend services to support ML workflows and clinical analytics pipelines; data-driven Angular applications for patient portals and clinical dashboards; collaborated with data scientists and clinicians to translate ML insights into production systems.
Senior Backend & AI Systems Engineer at Digital IQ, Inc
August 2, 2018 - October 2, 2019
Designed AI-enabled health care platforms supporting large-scale clinical data processing; HIPAA-compliant data services for secure ingestion and processing of health care records; backend services to support ML workflows and clinical analytics pipelines; data-driven Angular applications for patient portals and clinical dashboards; collaborated with data scientists and clinicians to translate ML insights into production systems.
Senior AI Engineer / Tech Lead at DataScan, LP
November 1, 2019 - Present
Designed and deployed AI-powered microservices supporting real-time analytics and intelligent inventory optimization, improving system efficiency by 40%. Built ML inference APIs using FastAPI and asynchronous I/O for high-throughput predictions. Developed real-time data pipelines integrating RFID and barcode signals with analytics engines, reducing operational errors by 35%. Implemented event-driven AI architectures using Kafka for streaming ingestion and real-time decision-making. Migrated legacy analytics platforms to cloud-native, Kubernetes-based AI systems (AWS, Azure, GCP). Automated AI service deployment pipelines using Jenkins and GitLab CI, achieving deployment automation. Built reusable Terraform modules to standardize AI infrastructure across multi-cloud environments. Improved system reliability with Prometheus and Grafana for proactive data drift monitoring and service health.
Senior AI/ML Engineer at DATASCAN, LP
November 1, 2019 - December 31, 2025
Designed and built production-ready AI and Machine Learning systems, including agentic AI and large language model platforms, to support intelligent automation, decision support, and software development acceleration within regulated enterprise and healthcare environments. Architected and operated core AI and Machine Learning platform capabilities including model serving, prompt orchestration, policy enforcement, access control, and audit logging to enable secure development and consumption of LLM-powered services. Implemented end-to-end CI/CD pipelines for AI and ML systems supporting automated testing, model and prompt versioning, artifact promotion, canary deployments, blue-green releases, rollback strategies, and continuous delivery of production ML and LLM services. Deployed, managed, and scaled AI and ML workloads on Azure using Azure ML, Azure OpenAI, Cognitive Services, AKS, Kubernetes, and GPU-backed compute, ensuring scalability, reliability, and compliance with enterprise an

Education

Bachelor's Degree in Computer Science at University of Illinois Urbana-Champaign
January 1, 2011 - January 1, 2015
Master's Degree in Computer Science at University of California, Santa Cruz
January 1, 2015 - January 1, 2016
Bachelor's Degree in Computer Science at University of Illinois Urbana-Champaign
January 1, 2011 - January 1, 2015
Master's Degree in Computer Science at University of California, Santa Cruz
January 1, 2015 - January 1, 2016
Bachelor's Degree in Computer Science at University of Illinois at Urbana-Champaign
January 1, 2011 - January 1, 2015
Master's Degree in Computer Science at University of California, Santa Cruz
January 1, 2015 - January 1, 2016
Bachelor’s Degree in Computer Science at University of Illinois Urbana
January 1, 2011 - January 1, 2015
Master’s Degree in Computer Science at University of California, Santa Cruz
January 1, 2015 - January 1, 2016

Qualifications

Add your qualifications or awards here.

Industry Experience

Financial Services, Retail, Healthcare, Software & Internet, Professional Services, Life Sciences, Other