Topics / #llamacpp

Llamacpp projects on GitHub

Lightweight C++ inference engine for running large language models locally on consumer hardware.

As of , the most-starred Llamacpp projects on GitHub are claw-code (194.9K stars), jan (45K stars) and marker (40.5K stars). GitHub.Locker tracks 32 Llamacpp repositories with 619.1K stars combined. The fastest-growing on October 16 was llamafile, with +67 stars in a day.

32Projects
619.1KStars in total
+379Stars in a day
Browse in the catalog →github.com/topics/llamacpp ↗

Hot right now

Most stars gained in a day · Oct 16

+67

llamafile

mozilla-ai/llamafile · ★ 26.4K

llamafile turns open LLMs into single-file executables: one file that runs a chat model locally on most operating systems and CPU architectures, with no installation. It is a Mozilla Builders project, now revamped by Mozilla.ai.

+58

project-maya

mw00/project-maya · ★ 954

Project Maya lets you run GLM-5.3-Flash, a 321-billion-parameter mixture-of-experts AI model, on your own NVIDIA GPU(s) by streaming the model's experts across VRAM, RAM and NVMe SSD as the conversation needs them.

+38

claw-code

ultraworkers/claw-code · ★ 194.9K

Claw Code is the public Rust implementation of 'claw', a CLI coding-agent harness. By its own README it is less a production tool and more an 'agent-managed museum exhibit' maintained entirely by AI agents/harnesses with no human intervention, in the spirit of (but unaffiliated with) Claude Code.

+36

openwhispr

OpenWhispr/openwhispr · ★ 9.5K

OpenWhispr is an open-source, privacy-first voice-to-text dictation app for desktop. Press a hotkey, speak, and the text appears at your cursor, with extra features like an AI voice assistant, meeting transcription, and notes.

The all-time top

32 projects · by stars

  1. #1 · ultraworkers/claw-code

    claw-code

    Claw Code is the public Rust implementation of 'claw', a CLI coding-agent harness. By its own README it is less a production tool and more an 'agent-managed museum exhibit' maintained entirely by AI agents/harnesses with no human intervention, in the spirit of (but unaffiliated with) Claude Code.

    194.9K
  2. #2 · janhq/jan

    jan

    Jan is an open-source, self-hosted alternative to ChatGPT that runs 100% offline on your own computer, letting you download and run LLMs locally with full control and privacy.

    45K
  3. #3 · datalab-to/marker

    marker

    Marker is a document conversion tool that turns PDFs (and other document types) into markdown, JSON, HTML, or chunked output quickly and accurately, extracting tables, equations, forms, and images along the way.

    40.5K
  1. 4

    khoj

    37.7Kkhoj-ai/khoj · Python

    Khoj is an open-source personal AI — a 'second brain' that answers your questions from the web and your own documents, runs custom agents for you, and works with any online or local LLM.

  2. 5

    self-llm

    32.5Kdatawhalechina/self-llm · Jupyter Notebook

    Self-llm is a Chinese-language tutorial collection that teaches beginners how to configure environments, deploy, and fine-tune (full-parameter or LoRA) 50+ open-source large language models and multimodal models on Linux.

  3. 6

    Qwen3

    27.7KQwenLM/Qwen3 · Python

    Qwen3 is a series of open-weight large language models built by the Qwen team at Alibaba Cloud, released as both dense and Mixture-of-Experts (MoE) models from 0.6B up to 235B-A22B parameters, with switchable 'thinking' and 'non-thinking' reasoning modes.

  4. 7

    llamafile

    26.4Kmozilla-ai/llamafile · C++

    llamafile turns open LLMs into single-file executables: one file that runs a chat model locally on most operating systems and CPU architectures, with no installation. It is a Mozilla Builders project, now revamped by Mozilla.ai.

  5. 8

    kotaemon

    25.8KCinnamon/kotaemon · Python

    Kotaemon is an open-source RAG tool for chatting with your documents: a clean web UI where you ask questions about your own files, serving both end users and developers.

  6. 9

    surya

    21.5Kdatalab-to/surya · Python

    Surya is Datalab's open-source document OCR system built around a 650M parameter model. It reads text from images and PDFs, and also does layout analysis, reading order, and table recognition.

  7. 10

    Chinese-LLaMA-Alpaca

    18.9Kymcui/Chinese-LLaMA-Alpaca · Python

    Open-source Chinese LLaMA and Alpaca large language models. The base LLaMA was extended with a Chinese vocabulary and further pre-trained on Chinese data, and Alpaca versions were instruction-tuned on Chinese instructions; training and deployment scripts are open too.

  8. 11

    outlines

    15.9Kdottxt-ai/outlines · Python

    Outlines is an open-source Python library that makes LLMs return guaranteed-valid structured output — the structure is enforced during generation itself, so there is no fragile parsing or regex repair afterwards.

  9. 12

    Second-Me

    15.7Kmindverse/Second-Me · Python

    Second Me is an open-source project that lets you train a personal, locally-hosted AI model that preserves your identity, memory, and context, then connects it to a decentralized network so it can represent you across apps.

  10. 13

    llmware

    14.8Kllmware-ai/llmware · Python

    llmware is a Python framework for building enterprise RAG (retrieval-augmented generation) pipelines using small, specialized models that can run locally, on-device, or in private/self-hosted environments instead of relying on large cloud LLMs.

  11. 14

    speech-to-speech

    13.5Khuggingface/speech-to-speech · Python

    It's a low-latency, fully modular voice-agent pipeline (VAD -> STT -> LLM -> TTS) for building voice agents with open-source speech and language models, exposed over WebSocket and WebRTC via the OpenAI Realtime API event set.

  12. 15

    h2ogpt

    11.9Kh2oai/h2ogpt · Python

    h2oGPT is an open-source private chat application that lets you query and summarize your own documents or just chat with local LLMs, with no data leaving your machine.

  13. 16

    MiniCPM

    11.6KOpenBMB/MiniCPM · Jupyter Notebook

    MiniCPM is OpenBMB's family of small, open-source LLMs built for on-device and resource-constrained use. The newest release, MiniCPM5-2B, is a dense 2B-parameter model that reaches open-source state-of-the-art for its size class while staying competitive with much larger 4B-class models.

  14. 17

    llama-gpt

    10.9Kgetumbrel/llama-gpt · TypeScript

    LlamaGPT is a self-hosted, offline, ChatGPT-like chatbot powered by Llama 2 (and now Code Llama), so you get a familiar chat UI without sending any data to a third-party cloud.

  15. 18

    llama-cpp-python

    10.6Kabetlen/llama-cpp-python · Python

    'llama-cpp-python' provides Python bindings for the llama.cpp C/C++ library, giving both low-level ctypes access and a high-level API for running GGUF language models locally for text completion, chat, embeddings and more.

  16. 19

    runanywhere-sdks

    10.3KRunanywhereAI/runanywhere-sdks · C++

    A toolkit of eight SDKs over one C++ core that runs AI fully on-device — LLM chat, vision, speech, voice agents, RAG, and image generation — on phones, browsers, and desktops. Everything is private by default and works offline.

  17. 20

    openwhispr

    9.5KOpenWhispr/openwhispr · JavaScript

    OpenWhispr is an open-source, privacy-first voice-to-text dictation app for desktop. Press a hotkey, speak, and the text appears at your cursor, with extra features like an AI voice assistant, meeting transcription, and notes.

  18. 21

    turboquant_plus

    7KTheTom/turboquant_plus · Python

    TurboQuant+ is the research home for TurboQuant (ICLR 2026), a KV cache compression method for transformer LLMs. It shrinks the KV cache 3.8-6.4x using PolarQuant plus Walsh-Hadamard rotation, and this repo holds the Python reference implementation, validation papers and benchmark data.

  19. 22

    MOSS-TTS

    4.2KOpenMOSS/MOSS-TTS · Python

    MOSS-TTS Family is an open-source speech and sound generation model family from OpenMOSS, covering long-form narration, multi-speaker dialogue, voice design, sound effects, and real-time streaming text-to-speech.

  20. 23

    Bonsai-demo

    3.4KPrismML-Eng/Bonsai-demo · Shell

    Bonsai Demo is a local-inference demo for Bonsai 2 27B, a ternary-weight large language model that runs on a laptop or single GPU via llama.cpp or MLX, with chat, vision, and agentic tool-calling support out of the box.

  21. 24

    Agentlas-OS

    1.6Kagentlas-ai/Agentlas-OS · Python

    Agentlas OS keeps a pool of specialist AI agents in a hub and spins up a temporary orchestrator for each task, splitting work and staffing specialists pulled from your machine, your private cloud, and a public Hub. It is local-first and works with any model, running inside hosts like Claude Code, Codex, Cursor and Gemini.

  22. 25

    turnstone

    1.6Kturnstonelabs/turnstone · Python

    Turnstone is a self-hosted, local-first orchestration framework that gives LLMs real tools — shell, files, search, web, planning — and runs multi-turn agent conversations across your own cluster.

  23. 26

    Hy-MT2

    1.3KTencent-Hunyuan/Hy-MT2 · Python

    Hy-MT2 is Tencent Hunyuan's family of 'fast-thinking' multilingual translation models, released in three sizes (1.8B, 7B, and 30B-A3B MoE), that translate among 33 languages and follow complex translation instructions.

  24. 27

    backburner

    1KStayLameBro/backburner · Python

    Backburner lets a nearby iPhone act as a coprocessor for your Mac so a locally-run 27B LLM (Qwen3.8-27B) reads prompts faster and holds far more context. The phone connects over a 10 Gb/s USB-C cable and offloads part of the model's layers plus storage/attention for old context.

  25. 28

    project-maya

    954mw00/project-maya · C++

    Project Maya lets you run GLM-5.3-Flash, a 321-billion-parameter mixture-of-experts AI model, on your own NVIDIA GPU(s) by streaming the model's experts across VRAM, RAM and NVMe SSD as the conversation needs them.

  26. 29

    Spark-X2.5

    812XHToken/Spark-X2.5

    Spark-X2.5 is a series of two open-source language models (4B and 1.7B parameters) built for everyday conversation, writing, translation, coding, reasoning and agentic tool-use tasks, aiming for strong performance in a compact size.

  27. 30

    gufo

    781gufo-org/gufo · C++

    Gufo is a local inference engine built specifically for AMD Strix Halo hardware (Ryzen AI MAX+ 395 with Radeon 8060S / gfx1151, up to 128 GiB unified memory), serving text, speech, image and video models through an OpenAI-compatible API.

  28. 31

    SCM

    486allenv0/SCM · TypeScript

    SCM (Screen Memories) is a macOS desktop app that runs deep AI search locally over every photo and every video frame in a chosen folder, letting you search by meaning, on-screen text, or spoken dialogue, all without the cloud.

  29. 32

    Janus

    135Vibra-Ingenn/Janus · Go

    Janus is a single Go binary that runs local .gguf language models on your machine (GPU or CPU) and exposes an OpenAI-compatible API, so you can use local models without Python, Docker, or Ollama.

Often tagged together