Any endpoint routes through the ChatGPT, Claude, Grok, and Kimi subscriptions
you already pay for. No per-token pricing, no markup. Works in your app, IDE,
and CLI.
Stop paying twice. Bring the subscriptions, API keys, and custom endpoints you already use into one consistent surface.
Stop rewriting integrations. Chat, responses, embeddings, images, and audio sit behind OpenAI- and Anthropic-compatible APIs.
Build resilient chains. Route across providers and move to the next model when one is down, rate-limited, or over context.
Keep credentials yours. Provider keys are encrypted under recovery material only you hold; subscription providers run locally through official vendor CLIs.
EXPLORE THE STACK
SDK — @openllmsh/sdk, one package by subpath: typed protocol contracts, wire-format transforms across Anthropic, OpenAI and Responses, the sans-I/O tunnel mux, zero-knowledge vault crypto, the OpenAPI surface and MCP tool definitions. Install with bun install github:openllmsh/sdk#vX.Y.Z.
CLI — the single openllm binary: client launcher, MCP gateway with semantic search and memory, and the local daemon (openllm daemon) for subscription-backed provider CLIs.
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
There was an error while loading. Please reload this page.
Most used topics
Loading…
Uh oh!
There was an error while loading. Please reload this page.
You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.
