Smart Node: Self-hosted AI Server for Small Business
Dmytro Klymentiev
Published
An AI server a business installs on its own Linux box. It sits between day to day operations (email, messaging, documents, tasks) and whichever model providers the business chooses, so orchestration logic, agent definitions, audit trail and customer data stay on their infrastructure rather than with a SaaS vendor.
Architecture: an AI Gateway as the single egress point for every external LLM call, so providers (OpenAI, Anthropic, Ollama) are swappable without touching application code. Semantic memory on PostgreSQL with pgvector. YAML-defined workflow orchestration with crash recovery. Task tracking with approval gates and a full event log. Email and messenger channels for human handoff.
Open source components: Mesh (semantic memory), Rein (workflow orchestrator), Screenbox (isolated agent desktops with a real Chromium browser).
Running against real business operations. One inbound phone call, handled end to end, moving work through the whole node:
Site: https://smart-node.app