AJ

Aswitha Jadda

Available to hire

I’m an AI Software Engineer focused on building low-latency, high-throughput model-serving systems and production-grade MLOps/LLMOps pipelines.

About

I’m an AI Software Engineer focused on building low-latency, high-throughput model-serving systems and production-grade MLOps/LLMOps pipelines. I enjoy turning complex ML research into reliable infrastructure—optimizing tokenization, streaming data paths, and GPU inference runtimes to hit strict latency and uptime targets.

Over my career, I’ve designed distributed architectures for multi-tenant AI platforms, improved scalability to handle very high concurrency, and implemented robust observability and resilience patterns. I also contribute to open-source projects in the Transformers and Gradio ecosystem, helping raise code quality and reliability for real-world deployments.

  • 3 years' experience
  • Joined September 2026

Industry experience

  • Software & Internet
  • Computers & Electronics
  • Professional Services

Work experience

AI Software Engineer · Hugging FaceJul 2024 – Present · 2 yrs 5 mos

Scale and maintain multi-region distributed model registries using Go and Python, implementing custom connection pooling and gRPC health checks to support 45,000+ concurrent queries under a 99.99% uptime SLA. Design and deploy multi-tenant model-serving infrastructure on distributed AWS GPU clusters, targeting p99 latency under 120ms for serverless inference APIs during unpredictable peak traffic. Optimize training data streaming by building an Apache Arrow/Parquet chunk loader that reduces runtime memory consumption by 34%. Improve preprocessing performance with high-speed Rust tokenization routines (42% reduction in preprocessing latency). Architect distributed multi-agent memory abstractions with LangChain/LangGraph to keep cross-host context synchronization overhead under 15ms, overhaul caching with Redis and Pinecone to reduce cold-start delivery latency by 40% (85ms absolute speedup), and productionize post-training distillation pipelines using TRL to compress foundational LLMs i

Backend Software Engineer · FreshworksMay 2022 – Aug 2023 · 1 yr 4 mos

Decomposed legacy monolithic components into decoupled Spring Boot microservices, cutting CI/CD deployment time from 45 minutes to under 12 minutes (73% reduction). Redesigned multi-tenant REST APIs with strict validation layers to handle 8,000+ RPS while reducing p95 response latency by 18%. Re-architected an event-driven data sync pipeline using Apache Kafka, scaling to 15M+ daily payloads with deterministic delivery constraints and an end-to-end message drop rate under 0.01%. Implemented multi-tier distributed caching with Redis clusters to achieve an 82% cache hit rate and reduce primary MySQL CPU spikes by 25%. Added resilience patterns (Resilience4j circuit breakers and fallbacks) to maintain cross-service availability SLA of 99.95%.

Education

Master's in Computer and Information Science · Texas Tech University2024
Bachelor's in Information Technology · VVITU (Vasireddy Venkatadri International Technological University)2023
Masters in Computer and Information Science · Texas Tech University2024
Bachelors in Information Technology · VVITU (Vasireddy Venkatadri International Technological University)2023

Certifications and awards· 8

AWS Certified Machine Learning – Specialty2030 – 2026
AWS Certified Kubernetes Administrator (CKA)2030 – 2026
Databricks Certified Professional Data Engineer2030 – 2026
Databricks Certified Generative AI Engineer2030 – 2026

Hire Aswitha Jadda today

Post a job and invite Aswitha, or contact them directly. No hidden commission.

Post a job