Topics / #llm-gateway

LLM gateway projects on GitHub

Routing layers that unify access to multiple large language model providers behind one API.

As of , the most-starred LLM gateway projects on GitHub are OmniRoute (77.4K stars), litellm (61.4K stars) and free-claude-code (61K stars). GitHub.Locker tracks 32 LLM gateway repositories with 570.1K stars combined. The fastest-growing on October 16 was magpie, with +656 stars in a day.

32Projects
570.1KStars in total
+2.8KStars in a day
Browse in the catalog →github.com/topics/llm-gateway ↗

Hot right now

Most stars gained in a day · Oct 16

+656

magpie

yetone/magpie · ★ 14.4K

Magpie is a menu bar app that lists every AI coding agent installed on your machine next to the model each one is currently set to; click a value and pick a different model from a dropdown.

+444

freellmapi

tashfeenahmed/freellmapi · ★ 36.4K

FreeLLMAPI aggregates the free tiers of 34 LLM providers (635 free model endpoints, 474 model families) behind a single OpenAI-compatible /v1 endpoint, with smart routing, automatic failover, and encrypted key storage.

+356

OmniRoute

diegosouzapw/OmniRoute · ★ 77.4K

OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

+262

monid

monid-ai/monid · ★ 4.7K

It's 'OpenRouter for agent tools': one base URL and one key give an agent access to 2,000+ tools across 72+ providers, so you integrate one API instead of wiring up dozens of vendors yourself.

The all-time top

32 projects · by stars

  1. #1 · diegosouzapw/OmniRoute

    OmniRoute

    OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

    77.4K
  2. #2 · BerriAI/litellm

    litellm

    LiteLLM is an open source AI Gateway that gives you one unified interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and more) using the OpenAI API format.

    61.4K
  3. #3 · Alishahryar1/free-claude-code

    free-claude-code

    FCC (Free Claude Code) routes coding agents like Claude Code, Codex, and OpenCode to 50 ToS-friendly providers, giving you 1.3B+ free tokens every month.

    61K
  1. 4

    new-api

    50.1KQuantumNous/new-api · Go

    New API is a self-hosted gateway that unifies access to many AI providers (OpenAI, Claude, Gemini, DeepSeek, etc.) behind a single endpoint, converting between OpenAI-, Claude-, and Gemini-compatible formats and giving you usage tracking, billing, and access control.

  2. 5

    kong

    44.3KKong/kong · Lua

    Kong is a cloud-native API gateway that also acts as an AI and MCP gateway, handling routing, load balancing, authentication, and traffic management for microservices and LLM/agentic traffic.

  3. 6

    sub2api

    44.2KWei-Shaw/sub2api · Go

    Sub2API is an open-source, self-hosted gateway written in Go that unifies Claude, OpenAI, Gemini, and Grok subscriptions behind one API, letting a group of people pool (‘carpool’) a single subscription and split the cost while still using each provider’s native tools.

  4. 7

    one-api

    37.2Ksongquanpeng/one-api · JavaScript

    One API is a self-hosted LLM gateway and key management system: you pool API keys from many providers, and it serves them all through a single OpenAI-compatible API, with a web panel for users, quotas and billing.

  5. 8

    freellmapi

    36.4Ktashfeenahmed/freellmapi · TypeScript

    FreeLLMAPI aggregates the free tiers of 34 LLM providers (635 free model endpoints, 474 model families) behind a single OpenAI-compatible /v1 endpoint, with smart routing, automatic failover, and encrypted key storage.

  6. 9

    9router

    30.9Kdecolua/9router · JavaScript

    9Router is a local AI router and token saver: it connects coding tools like Claude Code, Codex, Cursor and Cline to 40+ providers and 100+ models, auto-falls back from your subscription to cheap and free models, and compresses tool output to save 20-40% of tokens.

  7. 10

    chatbot

    21Kvercel/chatbot · TypeScript

    An open-source AI chatbot template built by Vercel with Next.js and the AI SDK, meant as a starting point for building your own chatbot applications.

  8. 11

    opencodex

    17.5Klidge-jun/opencodex · TypeScript

    opencodex is a universal provider proxy that lets OpenAI Codex (CLI, App, SDK) and Claude Code run any LLM — Claude, Gemini, Grok, DeepSeek, Ollama, and 40+ other providers — instead of being locked to one vendor's backend.

  9. 12

    magpie

    14.4Kyetone/magpie · Go

    Magpie is a menu bar app that lists every AI coding agent installed on your machine next to the model each one is currently set to; click a value and pick a different model from a dropdown.

  10. 13

    gateway

    13.2KPortkey-AI/gateway · TypeScript

    An open-source AI gateway that routes your requests to 1,600+ language, vision, audio and image models across 45+ providers through one fast, friendly API, with guardrails, caching, retries and fallbacks built in.

  11. 14

    tyk

    10.9KTykTechnologies/tyk · Go

    Tyk is an open-source, cloud-native API Gateway that lets you manage REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol) traffic in one place, adding authentication, rate limiting, quotas and analytics to your APIs.

  12. 15

    bifrost

    8.9Kmaximhq/bifrost · Go

    An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

  13. 16

    gpt-load

    7.1Ktbphp/gpt-load · Go

    GPT-Load is a self-hosted AI gateway that routes API keys and subscription accounts (OpenAI, Anthropic, Gemini, and more) through a single entry point, with scheduling, failover, request logs, and usage accounting.

  14. 17

    router

    5.6Kweave-os/router · Go

    A drop-in proxy that routes every prompt from your coding agent or app to the best available model across Anthropic, OpenAI, Gemini, and OSS models via OpenRouter, cutting inference costs by 40-70% just by swapping the API endpoint.

  15. 18

    eve

    5.6Kvercel/eve · TypeScript

    eve is Vercel's open-source framework for building durable AI agents. It is filesystem-first: agent capabilities live in conventional file locations, so agent projects stay easy to inspect, extend, and operate.

  16. 19

    openclaw-zero-token

    5.2Klinuxhsj/openclaw-zero-token · TypeScript

    OpenClaw Zero Token is a fork of OpenClaw that lets you use major AI chat models like Claude, ChatGPT, Gemini, DeepSeek, Qwen, Doubao, Grok, Kimi, GLM and others for free, by logging into their official web UIs once in a browser instead of paying for API tokens, then routing calls to them through one unified gateway.

  17. 20

    monid

    4.7Kmonid-ai/monid · TypeScript

    It's 'OpenRouter for agent tools': one base URL and one key give an agent access to 2,000+ tools across 72+ providers, so you integrate one API instead of wiring up dozens of vendors yourself.

  18. 21

    ccx

    4KBenedictKing/ccx · Go

    CCX is a high-performance AI API proxy and protocol translation gateway that sits in front of Claude, OpenAI Chat, OpenAI Images, OpenAI Embeddings, Codex Responses, and Gemini APIs, giving you one unified entrypoint for all of them.

  19. 22

    workbuddy2api-panel

    3.6Klinguo2625469/workbuddy2api-panel · Go

    WorkBuddy2API Panel is a self-hosted gateway that turns Tencent CodeBuddy/WorkBuddy accounts into an OpenAI-compatible '/v1/chat/completions' API, pools multiple accounts, and auto-completes the official growth-center tasks, with a bundled web admin panel.

  20. 23

    vm2api

    1.2Kdofastted/vm2api · JavaScript

    vm2api is a self-hosted proxy that runs your Claude/Anthropic (or OpenAI-compatible) API traffic through a real-looking virtual machine or Docker 'slot' so the account looks like a genuine Claude Console client instead of relying on system-prompt tricks or persona injection.

  21. 24

    opencode2api

    921jasonxu114514/opencode2api · Go

    opencode2api is a Go-based proxy for the OpenCode Zen / Zen Go API that exposes standard OpenAI and Anthropic-compatible endpoints, so you can point normal OpenAI/Anthropic SDK clients at OpenCode models.

  22. 25

    ThinkWatch-Lite

    824ThinkWatchProject/ThinkWatch-Lite · TypeScript

    ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

  23. 26

    casbin-gateway

    642apache/casbin-gateway · Go

    An open-source gateway for the AI coding agents on your machine: it watches what every agent does, relays their model traffic through one endpoint covering 44 vendors, and grades whether the API behind each key is what you actually paid for.

  24. 27

    my-free-code

    624hkqr/my-free-code · Python

    My Free Code is an open-source gateway that sits between coding agents like Claude Code and dozens of LLM providers, handling model routing, streaming, tool calls, reasoning pass-through and fallback between providers.

  25. 28

    opengrok

    487OnlyTerp/opengrok · JavaScript

    opengrok lets you run other LLMs (Claude, GLM, Qwen, Gemini, DeepSeek, local models) inside an existing Grok Bot desktop install, with evidence-based wire maps so each model gets the correct request shape instead of a generic prompt.

  26. 29

    underclass

    237ghuntley/underclass · Rust

    It pools multiple ChatGPT/Codex and GitHub Copilot subscriptions behind one OpenAI-compatible endpoint — when one account runs dry it cools down until its window resets and comes back on its own.

  27. 30

    osw

    196yinxulai/osw · TypeScript

    One Switch is a local AI API gateway: point your AI client at one local address, and it automatically routes to and fails over between the LLM providers/models you configure behind it.

  28. 31

    busbar

    194GetBusbar/busbar · Rust

    Busbar is a self-hosted execution control plane that sits between AI applications and the AI providers they call, letting operators verify, govern, route, and record every model request, MCP tool call, and A2A agent delegation before it reaches its destination.

  29. 32

    Wispverse

    132mufengyuan6/Wispverse · Python

    Wispverse (芥子) is an AI-native evolution simulation game: 15-20 anthropomorphized characters autonomously develop division of labor, society and culture in a garden, while you play the 21st character — a disguised infiltrator who secretly steers the civilization through rare decision moments until they eventually identify you.

Often tagged together