Global

llm-gateway
32 projects tagged “llm-gateway” that gained the most stars yesterday
#25 · +656 · 1d ·GitHub

Download · Docs · Reference · Plugins · Discord · English · 简体中文

Creator
yetone
Size
151.3 MB
Stars
14.4K
Age
24d
Commits · 90 Days
#43 · +444 · 1d ·GitHub

Aggregate free tiers from dozens of providers, plus custom OpenAI-compatible chat, embedding, image, and audio endpoints, behind a single /v1 API. Keys are stored encrypted.

Size
19.8 MB
Stars
36.4K
Age
5mo
Commits · 90 Days
#67 · +356 · 1d ·GitHub

Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot.

Size
1.6 GB
Stars
77.4K
Age
8mo
Commits · 90 Days
#100 · +262 · 1d ·GitHub

ai · Docs · Tool catalog · Quickstart · Development guide

Creator
monid-ai
Size
4 MB
Stars
4.7K
Age
1mo
Commits · 90 Days
#102 · +259 · 1d ·GitHub

3B+ free tokens) from your terminal, app, IDE, or phone, and now from the browser with native browser sessions (multi-harness + multi-model) like OpenClaw (voice supported + ToS friendly)

Size
14.8 MB
Stars
61K
Age
8mo
Commits · 90 Days
#185 · +153 · 1d ·GitHub

Field Manual WebUI 包含运行桌面、六步首次运行检查、接入手册、Token 用量、三协议 Playground、路由诊断、配置、事件日志和账号安全页面。接入手册会生成 Chat、Responses、Anthropic、Python 和 JavaScript 示例,但始终使用 YOURAPIKEY 占位符,不把真实 Server Key 写入页面。

Size
0.5 MB
Stars
921
Age
2mo
Commits · 90 Days
#231 · +125 · 1d ·GitHub

go 之外的 expert 序列)。上报 200 ≠ 计分——面板在执行后轮询任务进度,达标即自动调用 Web 域领奖接口。

Size
12 MB
Stars
3.6K
Age
1mo
Commits · 90 Days
#279 · +104 · 1d ·GitHub

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

Size
36.7 MB
Stars
824
Age
1mo
Commits · 90 Days
#374 · +76 · 1d ·GitHub

AI API Gateway Platform for Subscription Quota Distribution

Creator
Wei-Shaw
Size
116.6 MB
Stars
44.2K
Age
9mo
Commits · 90 Days
#444 · +64 · 1d ·GitHub

Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready.

Creator
BerriAI
Size
2.4 GB
Stars
61.4K
Age
3y
Commits · 90 Days
#507 · +57 · 1d ·GitHub

This repository package is private (9router-app), so source/Docker execution is the expected local development path.

Creator
decolua
Size
16.9 MB
Stars
30.9K
Age
9mo
Commits · 90 Days
#600 · +48 · 1d ·GitHub

Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

Creator
lidge-jun
Size
291.5 MB
Stars
17.5K
Age
3mo
Commits · 90 Days
#649 · +44 · 1d ·GitHub

IMPORTANT] > - This project is intended solely for lawful and authorized AI API gateway, organization-level authentication, multi-model management, usage analytics, cost accounting, and private deployment scenarios.

Size
82.9 MB
Stars
50.1K
Age
2y
Commits · 90 Days
#784 · +36 · 1d ·GitHub

改代码自己构建:docker compose -f docker-compose.yml -f docker-compose.build.yml up -d --build(一键脚本用 --from-source)。

Creator
dofastted
Size
12.9 MB
Stars
1.2K
Age
1mo
Commits · 90 Days
#1063 · +25 · 1d ·GitHub

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode.

Creator
maximhq
Size
1.1 GB
Stars
8.9K
Age
1y
Commits · 90 Days
#1297 · +20 · 1d ·GitHub

eve is a filesystem-first framework for durable AI agents. Core agent capabilities live in conventional locations, so projects are easier to inspect, extend, and operate.

Creator
vercel
Size
104 MB
Stars
5.6K
Age
4mo
Commits · 90 Days
#1641 · +15 · 1d ·GitHub

Cache compensation is a highlight: selected OpenAI groups (price-first, stable, and premium) guarantee daily cache hit rates of 65%, 75%, or 85%, and if eligible requests fall short, Modelflare refunds the difference, visible on the usage dashboard after settlement.

Creator
tbphp
Size
32.5 MB
Stars
7.1K
Age
1y
Commits · 90 Days
#1965 · +11 · 1d ·GitHub

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 适配,可用于 key 管理与二次分发。单可执行文件,提供 Docker 镜像,一键部署,开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API.

Size
15.6 MB
Stars
37.2K
Age
3y
Commits · 90 Days
#2089 · +11 · 1d ·GitHub

underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.

Creator
ghuntley
Size
0.2 MB
Stars
237
Updated
CommitOct 16
Age
27d
Commits · 90 Days
#2686 · +7 · 1d ·GitHub

0 release. You can try the pre-release branch here. > Read more about what's next for Portkey in our Series A announcement.

Creator
Portkey-AI
Size
66.1 MB
Stars
13.2K
Age
3y
Commits · 90 Days
#3341 · +5 · 1d ·GitHub

Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.

Creator
weave-os
Size
29 MB
Stars
5.6K
Updated
CommitOct 17
Age
5mo
Commits · 90 Days
#3521 · +4 · 1d ·GitHub

A full-featured, hackable Next.js AI chatbot built by Vercel

Creator
vercel
Size
6.2 MB
Stars
21K
Updated
CommitJul 08
Age
3y
Commits · 90 Days
#4245 · +3 · 1d ·GitHub

Use LLMs without API tokens — log in via browser once, then call ChatGPT, Claude, Gemini, DeepSeek, Qwen (intl/cn), Doubao, Kimi, Zhipu GLM, Grok, Xiaomi MiMo, Manus and more for free through a unified gateway.

Creator
linuxhsj
Size
222.8 MB
Stars
5.2K
Age
7mo
Commits · 90 Days
#4394 · +2 · 1d ·GitHub

Kong or Kong Gateway is a cloud-native, platform-agnostic, scalable API 𖧹 LLM 𖧹 MCP Gateway distinguished for its high performance and extensibility via plugins.

Creator
Kong
Size
95.7 MB
Stars
44.3K
Age
11y
Commits · 90 Days
#5119 · +2 · 1d ·GitHub

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

Creator
GetBusbar
Size
168.1 MB
Stars
194
Age
4mo
Commits · 90 Days
#5877 · +1 · 1d ·GitHub

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

Size
262 MB
Stars
10.9K
Age
12y
Commits · 90 Days
#6051 · +1 · 1d ·GitHub

CCX is a high-performance AI API proxy and protocol translation gateway for Claude, OpenAI Chat, OpenAI Images, OpenAI Embeddings, Codex Responses, and Gemini.

Size
30.3 MB
Stars
4K
Age
8mo
Commits · 90 Days
#6150 · +1 · 1d ·GitHub

Run any model in Grok Bot — one-command setup, model picker UI, evidence-based provider wire maps, and an update-proof doctor. Not farming you, arming you.

Creator
OnlyTerp
Size
5.6 MB
Stars
487
Updated
CommitSep 22
Age
1mo
Commits · 90 Days
#7882 · +0 · 1d ·GitHub

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.

Creator
apache
Size
4.8 MB
Stars
642
Updated
CommitOct 11
Age
9y
Commits · 90 Days
#7887 · +0 · 1d ·GitHub

Open-source multi-provider AI gateway for Claude Code and other coding agents, with model routing, streaming, tools, reasoning, fallbacks, and local model support

Creator
hkqr
Size
0.7 MB
Stars
624
Updated
CommitOct 15
Age
1mo
Commits · 90 Days