Topics / #load-balancer

Load-balancer projects on GitHub

Distributing traffic across servers using reverse proxies and load balancing tools.

As of , the most-starred Load-balancer projects on GitHub are OmniRoute (77.4K stars), traefik (65.3K stars) and litellm (61.4K stars). GitHub.Locker tracks 39 Load-balancer repositories with 857K stars combined. The fastest-growing on October 16 was freellmapi, with +444 stars in a day.

39Projects
857KStars in total
+1.2KStars in a day
Browse in the catalog →github.com/topics/load-balancer ↗

Hot right now

Most stars gained in a day · Oct 16

+444

freellmapi

tashfeenahmed/freellmapi · ★ 36.4K

FreeLLMAPI aggregates the free tiers of 34 LLM providers (635 free model endpoints, 474 model families) behind a single OpenAI-compatible /v1 endpoint, with smart routing, automatic failover, and encrypted key storage.

+356

OmniRoute

diegosouzapw/OmniRoute · ★ 77.4K

OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

+161

awesome-system-design-resources

ashishps1/awesome-system-design-resources · ★ 42.4K

A free, curated collection of System Design resources: core concepts, networking and API fundamentals, database and caching basics, distributed systems patterns, and a huge list of interview problems, books, courses, and papers — all aimed at prepping for System Design interviews.

+64

litellm

BerriAI/litellm · ★ 61.4K

LiteLLM is an open source AI Gateway that gives you one unified interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and more) using the OpenAI API format.

The all-time top

39 projects · by stars

  1. #1 · diegosouzapw/OmniRoute

    OmniRoute

    OmniRoute is a free, open-source AI gateway that puts 359 providers and 1200+ models (Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax, etc.) behind one API endpoint, with quota-aware automatic fallback when a provider runs out.

    77.4K
  2. #2 · traefik/traefik

    traefik

    Traefik is a modern HTTP reverse proxy and load balancer built to make deploying and exposing microservices easy, with automatic configuration based on your infrastructure.

    65.3K
  3. #3 · BerriAI/litellm

    litellm

    LiteLLM is an open source AI Gateway that gives you one unified interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and more) using the OpenAI API format.

    61.4K
  1. 4

    kong

    44.3KKong/kong · Lua

    Kong is a cloud-native API gateway that also acts as an AI and MCP gateway, handling routing, load balancing, authentication, and traffic management for microservices and LLM/agentic traffic.

  2. 5

    pm2

    43.3KUnitech/pm2 · JavaScript

    PM2 is a production process manager for Node.js and Bun applications that keeps them running forever, reloads them without downtime, and includes a built-in load balancer.

  3. 6

    awesome-system-design-resources

    42.4Kashishps1/awesome-system-design-resources · Java

    A free, curated collection of System Design resources: core concepts, networking and API fundamentals, database and caching basics, distributed systems patterns, and a huge list of interview problems, books, courses, and papers — all aimed at prepping for System Design interviews.

  4. 7

    istio

    38.4Kistio/istio · Go

    Istio is an open-source service mesh that layers transparently onto existing distributed applications, giving you a uniform way to secure, connect, and monitor microservices with few or no code changes.

  5. 8

    one-api

    37.2Ksongquanpeng/one-api · JavaScript

    One API is a self-hosted LLM gateway and key management system: you pool API keys from many providers, and it serves them all through a single OpenAI-compatible API, with a web panel for users, quotas and billing.

  6. 9

    freellmapi

    36.4Ktashfeenahmed/freellmapi · TypeScript

    FreeLLMAPI aggregates the free tiers of 34 LLM providers (635 free model endpoints, 474 model families) behind a single OpenAI-compatible /v1 endpoint, with smart routing, automatic failover, and encrypted key storage.

  7. 10

    go-zero

    33.4Kzeromicro/go-zero · Go

    go-zero is a cloud-native Go framework for building web and RPC microservices, packed with built-in engineering practices. It has been serving sites with tens of millions of users for years and is listed in the CNCF Landscape.

  8. 11

    nginx

    31.9Knginx/nginx · C

    NGINX ('engine x') is a free, open source web server, load balancer, reverse proxy, API gateway and content cache — described as the world's most popular web server.

  9. 12

    spring-cloud-alibaba

    29.2Kalibaba/spring-cloud-alibaba · Java

    A Spring Cloud toolkit from Alibaba: a one-stop set of components for building distributed Java applications on Alibaba middleware such as Nacos, Sentinel, RocketMQ and Seata.

  10. 13

    pingora

    27.6Kcloudflare/pingora · Rust

    Pingora is a Rust framework by Cloudflare for building fast, reliable, and programmable network services and proxies. It is battle-tested, having served more than 40 million internet requests per second for years.

  11. 14

    ngrok

    24.4Kinconshreveable/ngrok · Go

    ngrok is a globally distributed reverse proxy that secures, protects and accelerates applications and network services wherever they run, combining a reverse proxy, firewall, API gateway and global load balancer into one tool.

  12. 15

    ingress-nginx

    19.5Kkubernetes/ingress-nginx · Go

    ingress-nginx was an Ingress controller for Kubernetes that used NGINX as a reverse proxy and load balancer to route traffic into clusters. The project is now retired.

  13. 16

    brpc

    17.6Kapache/brpc · C++

    bRPC is an industrial-grade C++ RPC framework built at Baidu for high-performance systems like search, storage, machine learning, advertisement and recommendation; the name stands for 'better RPC'.

  14. 17

    apisix

    17.2Kapache/apisix · Lua

    Apache APISIX is an open-source, dynamic, real-time, high-performance API Gateway that also serves as an AI Gateway. It provides traffic management — load balancing, canary release, circuit breaking, authentication, observability — for both north-south and east-west traffic.

  15. 18

    caprover

    15.2Kcaprover/caprover · TypeScript

    CapRover is a self-hosted platform-as-a-service (PaaS) that lets you deploy and manage web apps, APIs, and databases on your own server without manually configuring Docker or nginx.

  16. 19

    coturn

    14.5Kcoturn/coturn · C

    coturn is a free, open-source implementation of a TURN and STUN server, used as a VoIP media relay and NAT traversal gateway, commonly deployed alongside WebRTC applications.

  17. 20

    workflow

    14.4Ksogou/workflow · C++

    Sogou C++ Workflow is an enterprise-grade C++ engine for asynchronous networking and parallel computing, used internally by Sogou to power search, cloud input method, and ad services, handling billions of requests daily.

  18. 21

    coredns

    14.4Kcoredns/coredns · Go

    A fast and flexible DNS server and forwarder written in Go, built as a chain of plugins — each plugin performs one DNS function. It is a graduated Cloud Native Computing Foundation (CNCF) project.

  19. 22

    nginx-admins-handbook

    14.3Ktrimstray/nginx-admins-handbook · Shell

    A free, community-maintained handbook of personal notes, tips, and gotchas for administering, securing, and tuning NGINX (and OpenResty/Tengine) in production.

  20. 23

    node-http-proxy

    14.1Khttp-party/node-http-proxy · JavaScript

    node-http-proxy is a programmable HTTP proxying library for Node.js that also supports WebSockets, used to build things like reverse proxies and load balancers.

  21. 24

    zuul

    14.1KNetflix/zuul · Java

    Zuul is Netflix's L7 (application-layer) gateway service that handles dynamic routing, monitoring, resiliency, and security for traffic flowing into a set of backend services.

  22. 25

    dnscrypt-proxy

    13.7KDNSCrypt/dnscrypt-proxy · Go

    dnscrypt-proxy is a flexible DNS proxy that supports modern encrypted DNS protocols like DNSCrypt v2, DNS-over-HTTPS (DoH), Anonymized DNSCrypt and ODoH, so your DNS queries can't be read or tampered with in transit.

  23. 26

    tengine

    13.4Kalibaba/tengine · C

    Tengine is a high-performance web server and reverse proxy originated by Taobao, built as a fork of nginx that stays 100% compatible with it while adding extra enterprise features.

  24. 27

    eureka

    12.7KNetflix/eureka · Java

    Eureka is a RESTful service used mainly in AWS cloud environments for service discovery, load balancing, and failover of mid-tier servers, originally built for Netflix's own infrastructure.

  25. 28

    awesome-system-design

    12.6Kmadd86/awesome-system-design

    A curated list of articles, books, videos, and tools for learning System Design (distributed systems), useful both for interview prep and for designing real distributed/microservice applications.

  26. 29

    ubicloud

    12.3Kubicloud/ubicloud · Ruby

    Ubicloud is an open source cloud platform that runs on bare metal servers, offering elastic compute, non-replicated block storage, firewall and load balancer, managed Postgres, Kubernetes, AI inference, and IAM services as an open alternative to AWS.

  27. 30

    resty

    11.8Kgo-resty/resty · Go

    Resty is a simple HTTP, REST, and SSE client library for Go — you add it to your Go project to call web services.

  28. 31

    fancyss_history_package

    11Khq450/fancyss_history_package

    This repository stores offline installation packages for the fancyss plugin, a proxy tool that lets Asuswrt/Asuswrt-Merlin routers bypass the GFW using protocols like Shadowsocks, V2ray, Xray, Trojan, and Hysteria2.

  29. 32

    gpt-load

    7.1Ktbphp/gpt-load · Go

    GPT-Load is a self-hosted AI gateway that routes API keys and subscription accounts (OpenAI, Anthropic, Gemini, and more) through a single entry point, with scheduling, failover, request logs, and usage accounting.

  30. 33

    MasterDnsVPN

    7.1Kmasterking32/MasterDnsVPN · Go

    MasterDnsVPN is a DNS tunneling VPN that smuggles TCP traffic inside DNS queries and responses to get online when regular connections are blocked, aiming for the same goal as DNSTT or SlipStream but using its own lower-overhead protocol.

  31. 34

    antigravity-claude-proxy

    4Kbadrisnarayanan/antigravity-claude-proxy · JavaScript

    This is a proxy server that exposes Antigravity's Claude and Gemini models through an Anthropic-compatible API, so you can use them inside Claude Code CLI and OpenClaw/ClawdBot.

  32. 35

    CFNext

    1.9KPAICNI/CFNext · JavaScript

    CFNext is a proxy subscription management panel you deploy on Cloudflare Workers or Pages; a single script both runs the actual VLESS/Trojan/XHTTP proxy and serves a /sub subscription link plus a graphical config panel.

  33. 36

    free-router-proxy

    479www222fff/free-router-proxy · JavaScript

    Free Router is a local OpenAI-compatible gateway that points your client at free models from any OpenAI-compatible provider you configure, ranking them and failing over automatically when one is rate-limited, down, or has no key.

  34. 37

    codex-subscription-router

    414b-nnett/codex-subscription-router · Go

    Codex Subscription Router is an unofficial macOS desktop app that builds a locally patched copy of the official ChatGPT app so you can use multiple ChatGPT/Codex subscriptions from one window, with new chats automatically balanced across whichever accounts have the most quota.

  35. 38

    underclass

    237ghuntley/underclass · Rust

    It pools multiple ChatGPT/Codex and GitHub Copilot subscriptions behind one OpenAI-compatible endpoint — when one account runs dry it cools down until its window resets and comes back on its own.

  36. 39

    busbar

    194GetBusbar/busbar · Rust

    Busbar is a self-hosted execution control plane that sits between AI applications and the AI providers they call, letting operators verify, govern, route, and record every model request, MCP tool call, and A2A agent delegation before it reaches its destination.

Often tagged together