Topics / #ai-infrastructure

AI infrastructure projects on GitHub

Platform infrastructure for building and running AI-powered services.

As of , the most-starred AI infrastructure projects on GitHub are chroma (29.5K stars), llm-action (25.2K stars) and sealos (18.4K stars). GitHub.Locker tracks 11 AI infrastructure repositories with 121.9K stars combined. The fastest-growing on October 17 was harnessrouter, with +39 stars in a day.

11Projects
121.9KStars in total
+119Stars in a day
Browse in the catalog →github.com/topics/ai-infrastructure ↗

Hot right now

Most stars gained in a day · Oct 17

+39

harnessrouter

HarnessRouter/harnessrouter · ★ 3.1K

HarnessRouter is a self-hosted gateway that turns existing agent harnesses like Codex, Claude Code, Hermes, PI, and DSH into a single unified API, so a product can run tasks, stream progress, and switch harnesses without handling harness-specific engineering.

+35

ai-infra-book

bojieli/ai-infra-book · ★ 6.7K

An open-source book, 'Understanding AI Infra: Quantitative Analysis and System Design' by Bojie Li, that derives LLM inference and training system designs from hardware constraints and model architecture using quantitative, order-of-magnitude estimates.

+20

semantica

semantica-agi/semantica · ★ 14.1K

Semantica is an open-source, graph-native infrastructure layer that ingests enterprise data and builds a structured Context Graph and knowledge graph with deterministic reasoning, ontology governance, and full decision provenance, so AI systems can be explained and audited instead of treated as black boxes.

+8

chroma

chroma-core/chroma · ★ 29.5K

Chroma is open-source data infrastructure for AI: a vector database that powers search for embeddings, used for things like retrieval-augmented generation (RAG) and AI agent memory.

The all-time top

11 projects · by stars

  1. #1 · chroma-core/chroma

    chroma

    Chroma is open-source data infrastructure for AI: a vector database that powers search for embeddings, used for things like retrieval-augmented generation (RAG) and AI agent memory.

    29.5K
  2. #2 · liguodongiot/llm-action

    llm-action

    It is a Chinese-language hub of in-depth tutorials on large language model engineering: training, fine-tuning, distributed training, inference, compression, evaluation, data engineering, LLMOps and AI infrastructure, organized as a big index linking the author's article series, many with companion code.

    25.2K
  3. #3 · labring/sealos

    sealos

    Sealos is an AI-native cloud operating system built on Kubernetes. It unifies the whole application lifecycle — from development in cloud IDEs to production deployment and management — targeting AI apps, SaaS platforms and microservices.

    18.4K
  1. 4

    semantica

    14.1Ksemantica-agi/semantica · Python

    Semantica is an open-source, graph-native infrastructure layer that ingests enterprise data and builds a structured Context Graph and knowledge graph with deterministic reasoning, ontology governance, and full decision provenance, so AI systems can be explained and audited instead of treated as black boxes.

  2. 5

    skypilot

    10.7Kskypilot-org/skypilot · Python

    SkyPilot is an open-source system for running, managing, and scaling AI workloads — training, serving, batch inference — on any infrastructure: your own Kubernetes or Slurm clusters, reserved GPUs, or 20+ clouds.

  3. 6

    ai-infra-book

    6.7Kbojieli/ai-infra-book · Python

    An open-source book, 'Understanding AI Infra: Quantitative Analysis and System Design' by Bojie Li, that derives LLM inference and training system designs from hardware constraints and model architecture using quantitative, order-of-magnitude estimates.

  4. 7

    skillhub

    5.2Kiflytek/skillhub · Java

    SkillHub is a self-hosted, open-source agent skill registry that lets enterprises publish, version, and govern reusable agent skill packages behind their own firewall.

  5. 8

    LongMemory

    4.5KCaviraOSS/LongMemory · TypeScript

    LongMemory is a cognitive memory engine that gives LLM applications and autonomous agents durable, temporal, governed memory instead of being stateless between sessions.

  6. 9

    InfraTech

    4.2KCalvinXKY/InfraTech · Jupyter Notebook

    InfraTech is a collection of Jupyter notebooks and articles sharing AI Infra knowledge: training/inference frameworks (PyTorch, vLLM/SGLang, slime/vime), performance acceleration, deep learning fundamentals and AI hardware/software basics.

  7. 10

    harnessrouter

    3.1KHarnessRouter/harnessrouter · Python

    HarnessRouter is a self-hosted gateway that turns existing agent harnesses like Codex, Claude Code, Hermes, PI, and DSH into a single unified API, so a product can run tasks, stream progress, and switch harnesses without handling harness-specific engineering.

  8. 11

    autumn-recruitment

    267Akun-python/autumn-recruitment · Jupyter Notebook

    It is a community-built, Chinese-language collection of Jupyter notebooks covering math foundations, data structures, machine learning, deep learning, LLMs, agents, AI infrastructure, speech, and data science, aimed at job-hunting ('autumn recruitment') interview prep in the LLM era.

Often tagged together