Topics / #ai-gateway

AI gateway projects on GitHub

Gateways for routing and governing LLM API traffic

As of , the most-starred AI gateway projects on GitHub are OmniRoute (77.4K stars), litellm (61.4K stars) and new-api (50.1K stars). GitHub.Locker tracks 32 AI gateway repositories with 544.8K stars combined. The fastest-growing on October 16 was OmniRoute, with +356 stars in a day.

32Projects
544.8KStars in total
+913Stars in a day
Browse in the catalog →github.com/topics/ai-gateway ↗

Hot right now

Most stars gained in a day · Oct 16

+356

OmniRoute

diegosouzapw/OmniRoute · ★ 77.4K

OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

+104

ThinkWatch-Lite

ThinkWatchProject/ThinkWatch-Lite · ★ 824

ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

+64

litellm

BerriAI/litellm · ★ 61.4K

LiteLLM is an open source AI Gateway that gives you one unified interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and more) using the OpenAI API format.

+57

9router

decolua/9router · ★ 30.9K

9Router is a local AI router and token saver: it connects coding tools like Claude Code, Codex, Cursor and Cline to 40+ providers and 100+ models, auto-falls back from your subscription to cheap and free models, and compresses tool output to save 20-40% of tokens.

The all-time top

32 projects · by stars

  1. #1 · diegosouzapw/OmniRoute

    OmniRoute

    OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

    77.4K
  2. #2 · BerriAI/litellm

    litellm

    LiteLLM is an open source AI Gateway that gives you one unified interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and more) using the OpenAI API format.

    61.4K
  3. #3 · QuantumNous/new-api

    new-api

    New API is a self-hosted gateway that unifies access to many AI providers (OpenAI, Claude, Gemini, DeepSeek, etc.) behind a single endpoint, converting between OpenAI-, Claude-, and Gemini-compatible formats and giving you usage tracking, billing, and access control.

    50.1K
  1. 4

    kong

    44.3KKong/kong · Lua

    Kong is a cloud-native API gateway that also acts as an AI and MCP gateway, handling routing, load balancing, authentication, and traffic management for microservices and LLM/agentic traffic.

  2. 5

    1Panel

    37.2K1Panel-dev/1Panel · Go

    1Panel is an open-source Linux server management panel and lightweight AI management platform: a web GUI that gives you one-stop control over servers, websites, apps and AI agents.

  3. 6

    Antigravity-Manager

    32.3Klbjlaq/Antigravity-Manager · Rust

    Antigravity-Manager is a desktop app for managing and one-click switching between multiple Antigravity-style AI accounts (Gemini, Claude, Codex), and it also runs a local proxy that turns those web-session accounts into standard OpenAI/Anthropic/Gemini API endpoints.

  4. 7

    9router

    30.9Kdecolua/9router · JavaScript

    9Router is a local AI router and token saver: it connects coding tools like Claude Code, Codex, Cursor and Cline to 40+ providers and 100+ models, auto-falls back from your subscription to cheap and free models, and compresses tool output to save 20-40% of tokens.

  5. 8

    mlflow

    28.4Kmlflow/mlflow · Python

    MLflow is an open source AI engineering platform for agents, LLM apps, and classic ML models: one place to trace, evaluate, monitor, and optimize production AI while controlling costs. It is widely adopted, with over 60 million monthly downloads.

  6. 9

    ai

    27.4Kvercel/ai · TypeScript

    It's the AI SDK — a free, open-source TypeScript toolkit from Vercel (the Next.js team) for building AI-powered applications and agents with Next.js, React, Svelte, Vue, Angular and Node.js.

  7. 10

    pangolin

    23.1Kfosrl/pangolin · TypeScript

    Pangolin is an open-source SASE (Secure Access Service Edge) platform built on WireGuard that unifies a zero-trust VPN, reverse proxy, privileged access management, and an identity-aware AI gateway under one identity and policy model.

  8. 11

    opencodex

    17.5Klidge-jun/opencodex · TypeScript

    opencodex is a universal provider proxy that lets OpenAI Codex (CLI, App, SDK) and Claude Code run any LLM — Claude, Gemini, Grok, DeepSeek, Ollama, and 40+ other providers — instead of being locked to one vendor's backend.

  9. 12

    apisix

    17.2Kapache/apisix · Lua

    Apache APISIX is an open-source, dynamic, real-time, high-performance API Gateway that also serves as an AI Gateway. It provides traffic management — load balancing, canary release, circuit breaking, authentication, observability — for both north-south and east-west traffic.

  10. 13

    casdoor

    14.6Kcasdoor/casdoor · Go

    Casdoor is an open-source, self-hosted identity and access management (IAM) platform: a single sign-on (SSO) and authentication server with a web console that speaks OAuth 2.0, OIDC, SAML 2.0, CAS, LDAP, SCIM 2.0, WebAuthn, TOTP/MFA, and MCP, and connects to providers like Google Workspace and Azure AD.

  11. 14

    gateway

    13.2KPortkey-AI/gateway · TypeScript

    An open-source AI gateway that routes your requests to 1,600+ language, vision, audio and image models across 45+ providers through one fast, friendly API, with guardrails, caching, retries and fallbacks built in.

  12. 15

    InsForge

    13.1KInsForge/InsForge · TypeScript

    InsForge is an all-in-one, open-source backend platform built for coding agents: it gives agents database, auth, storage, compute, hosting, and an AI gateway so they can ship full-stack apps end-to-end without a human wiring up the backend.

  13. 16

    tyk

    10.9KTykTechnologies/tyk · Go

    Tyk is an open-source, cloud-native API Gateway that lets you manage REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol) traffic in one place, adding authentication, rate limiting, quotas and analytics to your APIs.

  14. 17

    bifrost

    8.9Kmaximhq/bifrost · Go

    An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

  15. 18

    gpt-load

    7.1Ktbphp/gpt-load · Go

    GPT-Load is a self-hosted AI gateway that routes API keys and subscription accounts (OpenAI, Anthropic, Gemini, and more) through a single entry point, with scheduling, failover, request logs, and usage accounting.

  16. 19

    router

    5.6Kweave-os/router · Go

    A drop-in proxy that routes every prompt from your coding agent or app to the best available model across Anthropic, OpenAI, Gemini, and OSS models via OpenRouter, cutting inference costs by 40-70% just by swapping the API endpoint.

  17. 20

    OB1

    4.7KNateBJones-Projects/OB1 · TypeScript

    Open Brain (OB1) is an infrastructure layer that gives every AI tool you use — Claude, ChatGPT, Cursor, Claude Code, and whatever ships next — shared, persistent access to the same memory of you, through one database and one AI gateway.

  18. 21

    ccx

    4KBenedictKing/ccx · Go

    CCX is a high-performance AI API proxy and protocol translation gateway that sits in front of Claude, OpenAI Chat, OpenAI Images, OpenAI Embeddings, Codex Responses, and Gemini APIs, giving you one unified entrypoint for all of them.

  19. 22

    goclaw

    3.7Knextlevelbuilder/goclaw · Go

    GoClaw is a multi-tenant AI agent gateway/platform written in Go that connects 20+ LLM providers to 7 messaging channels, letting you deploy and orchestrate teams of AI agents at scale with production-grade security.

  20. 23

    fx

    3.5Kvercel-labs/fx · Zig

    fx is a Unix-like coding agent harness and CLI written in Zig, built for research and embeddability inside larger systems, with a strong focus on minimalism and performance.

  21. 24

    jevgrep

    2.8Kdzhng/jevgrep · TypeScript

    jevgrep (the jg CLI) lets coding agents find relevant code by describing what it does in a question, instead of searching for exact text or paths. It uses an engine called Jev to judge relevance across folders, files, and declarations and returns reading leads plus verbatim source excerpts to stdout.

  22. 25

    open-compute

    2Kelliothux/open-compute · Rust

    open-compute is a self-hosted platform that runs Cloudflare Workers code unchanged on hardware you control, reimplementing Workers, KV, D1, R2, Durable Objects, Queues, Workflows, Cron, Cache, Images, Vectorize and AI Search as a single Rust binary.

  23. 26

    ThinkWatch-Lite

    824ThinkWatchProject/ThinkWatch-Lite · TypeScript

    ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

  24. 27

    ai-system-design

    672amitshekhariitbhu/ai-system-design · Markdown

    A free, open-source guide that teaches AI System Design step by step: how to combine GPUs, inference servers, caches, vector databases, AI agents, guardrails, and evals into one system that is fast, cheap, reliable, and safe.

  25. 28

    casbin-gateway

    642apache/casbin-gateway · Go

    An open-source gateway for the AI coding agents on your machine: it watches what every agent does, relays their model traffic through one endpoint covering 44 vendors, and grades whether the API behind each key is what you actually paid for.

  26. 29

    my-free-code

    624hkqr/my-free-code · Python

    My Free Code is an open-source gateway that sits between coding agents like Claude Code and dozens of LLM providers, handling model routing, streaming, tool calls, reasoning pass-through and fallback between providers.

  27. 30

    free-router-proxy

    479www222fff/free-router-proxy · JavaScript

    Free Router is a local OpenAI-compatible gateway that points your client at free models from any OpenAI-compatible provider you configure, ranking them and failing over automatically when one is rate-limited, down, or has no key.

  28. 31

    DoulorCloud

    235Doulor/DoulorCloud · TypeScript

    Doulor Cloud is a self-hosted, all-in-one cloud resource distribution platform: each user gets a subdomain, a domain email address, R2-backed direct-link file storage, a personal Bento-style profile page, and access to a shared AI API relay, all running on a static frontend plus Cloudflare Workers with no persistent server.

  29. 32

    busbar

    194GetBusbar/busbar · Rust

    Busbar is a self-hosted execution control plane that sits between AI applications and the AI providers they call, letting operators verify, govern, route, and record every model request, MCP tool call, and A2A agent delegation before it reaches its destination.

Often tagged together