Multi tenant voice Bot

Akshay Kumar Apsingi
Published

0
  • Project creator

Voice agent that jumps on client calls

Each client instance comes with its own integration, dedicated knowledge base, CRM connectivity, and calendar sync. When a customer initiates a call, we dynamically spin up a server room where the agent seamlessly joins the conversation. Telephony integration over SIP ensures the caller is routed directly into this room.

Under the hood:

  • LiveKit orchestrates the end-to-end voice pipeline
  • Deepgram currently powers STT + TTS (while I’m also experimenting with Cartesian + ElevenLabs)
  • The LLM layer (Agno) is fully tailored, equipped with conversational memory, and wired into business APIs + CRM systems.

In this demo, I’ll bring the server online, activate the agent, and query it against a CRM dataset. The agent leverages custom-built tools to retrieve information efficiently and respond with precision in real time with low latency.

LinkedIn - https://www.twine.net/signin