Twine

LLM Token Cost Optimizer

Jacob Ralph
Published

0
  • Project creator

Phrase-based codebook system that cuts LLM token usage and cost.

Problem: token pricing adds up fast, and AI outputs repeat the same phrases, wasting cost, bandwidth and storage.

What we built: a codebook that replaces frequent multi-token phrases in JSON responses with short codes, while keeping full responses easy to reconstruct.

Stack: Node.js, OpenAI