Topics / #llm-proxy

LLM proxy projects on GitHub

Proxy servers that route, cache, and manage LLM API traffic.

As of , the most-starred LLM proxy projects on GitHub are OmniRoute (77.4K stars), headroom (75.5K stars) and 9router (30.9K stars). GitHub.Locker tracks 17 LLM proxy repositories with 255.9K stars combined. The fastest-growing on October 16 was OmniRoute, with +356 stars in a day.

17Projects
255.9KStars in total
+1.1KStars in a day
Browse in the catalog →github.com/topics/llm-proxy ↗

Hot right now

Most stars gained in a day · Oct 16

+356

OmniRoute

diegosouzapw/OmniRoute · ★ 77.4K

OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

+153

opencode2api

jasonxu114514/opencode2api · ★ 921

opencode2api is a Go-based proxy for the OpenCode Zen / Zen Go API that exposes standard OpenAI and Anthropic-compatible endpoints, so you can point normal OpenAI/Anthropic SDK clients at OpenCode models.

+144

billion-context

ranxianglei/billion-context · ★ 1.5K

billion-context is a context-compression proxy that sits between any coding agent and its model API, rewriting Anthropic/OpenAI streams so a 100K context window is enough and a single session can run for months across billions of tokens.

+104

ThinkWatch-Lite

ThinkWatchProject/ThinkWatch-Lite · ★ 824

ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

The all-time top

17 projects · by stars

  1. #1 · diegosouzapw/OmniRoute

    OmniRoute

    OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

    77.4K
  2. #2 · headroomlabs-ai/headroom

    headroom

    Headroom compresses everything an AI agent reads - tool outputs, logs, RAG chunks, files, and conversation history - before it reaches the LLM, cutting tokens while keeping the same answers. It ships as a library, a local proxy, and an MCP server.

    75.5K
  3. #3 · decolua/9router

    9router

    9Router is a local AI router and token saver: it connects coding tools like Claude Code, Codex, Cursor and Cline to 40+ providers and 100+ models, auto-falls back from your subscription to cheap and free models, and compresses tool output to save 20-40% of tokens.

    30.9K
  1. 4

    opencodex

    17.5Klidge-jun/opencodex · TypeScript

    opencodex is a universal provider proxy that lets OpenAI Codex (CLI, App, SDK) and Claude Code run any LLM — Claude, Gemini, Grok, DeepSeek, Ollama, and 40+ other providers — instead of being locked to one vendor's backend.

  2. 5

    gateway

    13.2KPortkey-AI/gateway · TypeScript

    An open-source AI gateway that routes your requests to 1,600+ language, vision, audio and image models across 45+ providers through one fast, friendly API, with guardrails, caching, retries and fallbacks built in.

  3. 6

    opencode-antigravity-auth

    10.9KNoeFabris/opencode-antigravity-auth · TypeScript

    It's an OpenCode plugin that authenticates via Google OAuth against Antigravity (Google's IDE), letting OpenCode use Antigravity's quota to run models like Gemini 3.1 Pro and Claude Opus 4.6-thinking under your own Google account instead of a separate API key.

  4. 7

    aichat

    10.5Ksigoden/aichat · Rust

    AIChat is an all-in-one LLM command-line tool: a shell assistant, a chat REPL, RAG, AI tools and agents, with access to OpenAI, Claude, Gemini, Ollama, Groq and more.

  5. 8

    bifrost

    8.9Kmaximhq/bifrost · Go

    An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

  6. 9

    relayAPI

    5.1Kzzsting88/relayAPI · TypeScript

    This is a Chinese-language guide that reviews and ranks third-party 'AI API relay stations' (中转站) — resellers that let users in China tap into OpenAI, Claude, Gemini, DeepSeek and other AI model APIs more cheaply and without official account bans.

  7. 10

    billion-context

    1.5Kranxianglei/billion-context · TypeScript

    billion-context is a context-compression proxy that sits between any coding agent and its model API, rewriting Anthropic/OpenAI streams so a 100K context window is enough and a single session can run for months across billions of tokens.

  8. 11

    vm2api

    1.2Kdofastted/vm2api · JavaScript

    vm2api is a self-hosted proxy that runs your Claude/Anthropic (or OpenAI-compatible) API traffic through a real-looking virtual machine or Docker 'slot' so the account looks like a genuine Claude Console client instead of relying on system-prompt tricks or persona injection.

  9. 12

    opencode2api

    921jasonxu114514/opencode2api · Go

    opencode2api is a Go-based proxy for the OpenCode Zen / Zen Go API that exposes standard OpenAI and Anthropic-compatible endpoints, so you can point normal OpenAI/Anthropic SDK clients at OpenCode models.

  10. 13

    ThinkWatch-Lite

    824ThinkWatchProject/ThinkWatch-Lite · TypeScript

    ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

  11. 14

    casbin-gateway

    642apache/casbin-gateway · Go

    An open-source gateway for the AI coding agents on your machine: it watches what every agent does, relays their model traffic through one endpoint covering 44 vendors, and grades whether the API behind each key is what you actually paid for.

  12. 15

    freebucks-proxy

    300trefeon/freebucks-proxy · Go

    A Go gateway that sits in front of FreeBuff and exposes OpenAI-compatible and Anthropic-compatible chat endpoints, translating requests into the FreeBuff wire protocol, with a built-in Svelte admin dashboard.

  13. 16

    underclass

    237ghuntley/underclass · Rust

    It pools multiple ChatGPT/Codex and GitHub Copilot subscriptions behind one OpenAI-compatible endpoint — when one account runs dry it cools down until its window resets and comes back on its own.

  14. 17

    busbar

    194GetBusbar/busbar · Rust

    Busbar is a self-hosted execution control plane that sits between AI applications and the AI providers they call, letting operators verify, govern, route, and record every model request, MCP tool call, and A2A agent delegation before it reaches its destination.

Often tagged together