Multi tenant voice Bot
Akshay Kumar Apsingi
Published
0
Voice agent that jumps on client calls
Each client instance comes with its own integration, dedicated knowledge base, CRM connectivity, and calendar sync. When a customer initiates a call, we dynamically spin up a server room where the agent seamlessly joins the conversation. Telephony integration over SIP ensures the caller is routed directly into this room.
Under the hood:
- LiveKit orchestrates the end-to-end voice pipeline
- Deepgram currently powers STT + TTS (while I’m also experimenting with Cartesian + ElevenLabs)
- The LLM layer (Agno) is fully tailored, equipped with conversational memory, and wired into business APIs + CRM systems.
In this demo, I’ll bring the server online, activate the agent, and query it against a CRM dataset. The agent leverages custom-built tools to retrieve information efficiently and respond with precision in real time with low latency.
LinkedIn - https://www.twine.net/signin