Topics / #llama

Llama projects on GitHub

Topic around the Llama family of open-weight language models and running them.

As of , the most-starred Llama projects on GitHub are ollama (183.5K stars), awesome-llm-apps (142.1K stars) and vllm (94K stars). GitHub.Locker tracks 61 Llama repositories with 1.6M stars combined. The fastest-growing on October 16 was ollama, with +169 stars in a day.

61Projects
1.6MStars in total
+1.1KStars in a day
Browse in the catalog →github.com/topics/llama ↗

Hot right now

Most stars gained in a day · Oct 16

+169

ollama

ollama/ollama · ★ 183.5K

Ollama is a tool for downloading and running open large language models like DeepSeek, Qwen, Gemma, Llama, Mistral and gpt-oss on your own machine, with a simple CLI and a local REST API.

+159

airllm

lyogavin/airllm · ★ 39.1K

An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

+139

awesome-llm-apps

Shubhamsaboo/awesome-llm-apps · ★ 142.1K

A collection of 100+ open-source AI agent, agent skill, and RAG app examples - hand-built, tested end-to-end, and released under Apache-2.0 so you can clone, run, or even sell them.

+73

vllm

vllm-project/vllm · ★ 94K

vLLM is a library for fast LLM inference and serving, built around PagedAttention for efficient memory management of attention keys and values.

The all-time top

61 projects · by stars

  1. #1 · ollama/ollama

    ollama

    Ollama is a tool for downloading and running open large language models like DeepSeek, Qwen, Gemma, Llama, Mistral and gpt-oss on your own machine, with a simple CLI and a local REST API.

    183.5K
  2. #2 · Shubhamsaboo/awesome-llm-apps

    awesome-llm-apps

    A collection of 100+ open-source AI agent, agent skill, and RAG app examples - hand-built, tested end-to-end, and released under Apache-2.0 so you can clone, run, or even sell them.

    142.1K
  3. #3 · vllm-project/vllm

    vllm

    vLLM is a library for fast LLM inference and serving, built around PagedAttention for efficient memory management of attention keys and values.

    94K
  1. 4

    unsloth

    78.2Kunslothai/unsloth · Python

    Unsloth is a local-first app for running and training LLMs, diffusion, TTS and embedding models on your own machine, including models like Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4 and FLUX.

  2. 5

    LlamaFactory

    75.5Khiyouga/LlamaFactory · Python

    LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.

  3. 6

    llama

    59.6Kmeta-llama/llama · Python

    This is Meta's reference inference code for running Llama 2 language models (7B to 70B parameters) locally, letting you load pre-trained or chat fine-tuned weights and generate text completions.

  4. 7

    LocalAI

    49.6Kmudler/LocalAI · Go

    LocalAI is an open-source, self-hosted AI engine that lets you run LLMs, vision, voice, image and video models on your own hardware, including CPU-only setups, through an OpenAI/Anthropic/ElevenLabs-compatible API.

  5. 8

    aider

    49.6KAider-AI/aider · Python

    Aider is an AI pair programming tool that runs in your terminal, letting you chat with an LLM to build new projects or edit an existing codebase.

  6. 9

    AstrBot

    42KAstrBotDevs/AstrBot · Python

    AstrBot is an open-source all-in-one AI agent chatbot platform that connects LLMs to messaging apps like QQ, Telegram, Discord, Slack, WeChat and more, so you can build a personal AI companion, customer service bot, or enterprise knowledge-base assistant inside your existing chat workflows.

  7. 10

    ColossalAI

    41.4Khpcaitech/ColossalAI · Python

    Colossal-AI is an open-source system for training and running large AI models more cheaply, faster and with less hardware, by providing a toolbox of parallelism and memory-optimization techniques.

  8. 11

    airllm

    39.1Klyogavin/airllm · Jupyter Notebook

    An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

  9. 12

    Langchain-Chatchat

    38.7Kchatchat-space/Langchain-Chatchat · Python

    Langchain-Chatchat is an open-source RAG and Agent application that lets you build a local-knowledge-base Q&A chatbot using LLMs like ChatGLM, Qwen or Llama through the LangChain framework.

  10. 13

    sglang

    37.2Ksgl-project/sglang · Python

    SGLang is a high-performance serving framework for large language models and multimodal models, built to deliver low-latency, high-throughput inference from a single GPU up to large distributed clusters.

  11. 14

    paper-reading

    34Kmli/paper-reading

    It's a curated reading list for deep learning: each entry is a recorded lecture that walks through a paper paragraph by paragraph, from classics like CLIP and GPT-3 to recent ones like Llama 3.1 and Sora.

  12. 15

    fish-speech

    33.2Kfishaudio/fish-speech · Python

    Fish Speech (Fish Audio S2) is a state-of-the-art open-source text-to-speech system that generates natural, emotionally rich speech in 80+ languages, led by the flagship S2-Pro model that combines a Dual-AR architecture with reinforcement-learning alignment.

  13. 16

    stanford_alpaca

    30.2Ktatsu-lab/stanford_alpaca · Python

    Stanford's official Alpaca repo: code and docs for training an instruction-following LLaMA model and generating its 52K instruction dataset. In preliminary human evaluation the 7B model behaved similarly to text-davinci-003.

  14. 17

    llama3

    29.2Kmeta-llama/llama3 · Python

    Meta's official GitHub home for Llama 3: model weights plus minimal code for running inference on pre-trained and instruction-tuned models in 8B and 70B sizes. The repo is now deprecated.

  15. 18

    repomix

    28.9Kyamadashy/repomix · TypeScript

    Repomix packs an entire repository into a single AI-friendly file you can feed to LLMs like Claude, ChatGPT, DeepSeek or Gemini — for code review, refactoring, docs or tests.

  16. 19

    open-r1

    26.5Khuggingface/open-r1 · Python

    Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.

  17. 20

    LLaVA

    25.1Khaotian-liu/LLaVA · Python

    LLaVA is an open-source large multimodal chatbot: a vision-language model you can show images to and talk with, built by visual instruction tuning toward GPT-4V-level capabilities (NeurIPS 2023 Oral).

  18. 21

    Awesome-Chinese-LLM

    22.8KAiHubCN/Awesome-Chinese-LLM

    A curated collection of open-source LLM resources for Chinese, focused on smaller models that can be privately deployed and trained cheaply. It lists 100+ resources: models, applications, datasets, and tutorials.

  19. 22

    ktransformers

    19.6Kkvcache-ai/ktransformers · Python

    KTransformers is a research framework for efficient inference and fine-tuning of large language models through CPU-GPU heterogeneous computing, letting huge MoE models run on hardware that doesn't have enough VRAM to hold them entirely on GPU.

  20. 23

    Chinese-LLaMA-Alpaca

    18.9Kymcui/Chinese-LLaMA-Alpaca · Python

    Open-source Chinese LLaMA and Alpaca large language models. The base LLaMA was extended with a Chinese vocabulary and further pre-trained on Chinese data, and Alpaca versions were instruction-tuned on Chinese instructions; training and deployment scripts are open too.

  21. 24

    alpaca-lora

    18.9Ktloen/alpaca-lora · Jupyter Notebook

    Alpaca-LoRA reproduces the Stanford Alpaca results by instruct-tuning LLaMA with low-rank adaptation (LoRA). It ships the training code, inference scripts, and the resulting LoRA weights, producing an Instruct model of similar quality to text-davinci-003.

  22. 25

    llama-cookbook

    18.6Kmeta-llama/llama-cookbook · Jupyter Notebook

    The Llama Cookbook — Meta's official collection of recipes for building with the Llama model family: inference, fine-tuning, RAG and end-to-end use cases, mostly written as Jupyter notebooks.

  23. 26

    codellama

    16.2Kmeta-llama/codellama · Python

    This is Meta's official inference code for Code Llama, a family of large language models for code built on Llama 2. The repo itself is a minimal example for loading the models and running generation.

  24. 27

    ms-swift

    15.9Kmodelscope/ms-swift · Python

    ms-swift is the ModelScope community's fine-tuning and deployment framework for LLMs and multimodal models, covering training, inference, evaluation, quantization and deployment in one pipeline.

  25. 28

    StableLM

    15.7KStability-AI/StableLM · Jupyter Notebook

    StableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.

  26. 29

    ChuanhuChatGPT

    15.3KGaiZhenbiao/ChuanhuChatGPT · Python

    ChuanhuChatGPT is a web-based GUI for ChatGPT and many other LLMs, adding extras like agents, file-based Q&A, local model deployment, web search, and GPT fine-tuning on top of a Gradio interface.

  27. 30

    llm_interview_note

    15.3Kwdndev/llm_interview_note · HTML

    This is a curated Chinese-language knowledge base of large language model (LLM) concepts and interview questions, aimed at algorithm/application engineers preparing for LLM-related job interviews.

  28. 31

    llama3-from-scratch

    15.2Knaklecha/llama3-from-scratch · Jupyter Notebook

    A Jupyter notebook that implements Llama3 entirely from scratch, building up every matrix multiplication by hand instead of calling pre-built transformer modules.

  29. 32

    TensorRT-LLM

    14.8KNVIDIA/TensorRT-LLM · Python

    TensorRT LLM is NVIDIA's Python framework for defining large language models (and now visual generation models) and compiling them into highly optimized inference engines that run on NVIDIA GPUs, with specialized kernels and Python/C++ runtimes.

  30. 33

    Llama-Chinese

    14.8KLlamaChinese/Llama-Chinese · Python

    Llama-Chinese is a Chinese-language community project built around Meta's Llama models (Llama2, Llama3, Llama4). It provides Chinese pretraining and fine-tuning, a custom Atom model series optimized for Chinese, and resources for training, deploying and using Llama in Chinese for free commercial use.

  31. 34

    csm

    14.7KSesameAILabs/csm · Python

    CSM (Conversational Speech Model) is a speech generation model from Sesame that turns text and audio input into spoken audio by producing RVQ audio codes, using a Llama backbone plus a smaller audio decoder.

  32. 35

    litgpt

    13.7KLightning-AI/litgpt · Python

    LitGPT is a collection of 20+ high-performance large language models (Llama, Gemma, Phi, Qwen, Mistral, Falcon, TinyLlama and more) implemented from scratch, with ready-made recipes to pretrain, finetune, evaluate and deploy them at scale.

  33. 36

    langchain4j

    13.3Klangchain4j/langchain4j · Java

    LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM, offering a unified API over popular LLM providers and vector stores.

  34. 37

    PaddleNLP

    13KPaddlePaddle/PaddleNLP · Python

    PaddleNLP is a large language model (LLM) and small language model (SLM) development toolkit built on the PaddlePaddle deep learning framework, offering efficient training, lossless compression, and high-performance inference for large models.

  35. 38

    dalai

    12.9Kcocktailpeanut/dalai · CSS

    Dalai is a tool that lets you download and run LLaMA or Alpaca language models directly on your own computer, with a web UI, a CLI, and a JavaScript/socket.io API, built on top of llama.cpp and alpaca.cpp.

  36. 39

    OpenLLM

    12.6Kbentoml/OpenLLM · Python

    OpenLLM lets you run open-source LLMs like Llama, DeepSeek, Mistral and Qwen as OpenAI-compatible API endpoints with a single command, including a built-in chat UI and cloud deployment support.

  37. 40

    shell_gpt

    12.3KTheR1D/shell_gpt · Python

    ShellGPT is a command-line productivity tool powered by AI large language models (like GPT-5) that generates shell commands, code snippets, and documentation directly in your terminal, so you skip googling.

  38. 41

    YuE

    12.1Kmultimodal-art-projection/YuE · Python

    YuE2 is an open-source music generation model: lyrics plus a style prompt become an editable melody-and-chord plan, then a complete song with vocals and accompaniment. It also does zero-shot covers and agent-driven editing.

  39. 42

    bisheng

    12.1Kdataelement/bisheng · Python

    BISHENG is an open-source LLM application devops platform built for enterprise AI, covering GenAI workflow building, RAG, agents, model management, evaluation, SFT, dataset management and observability.

  40. 43

    ludwig

    11.8Kludwig-ai/ludwig · Python

    Ludwig is a declarative deep learning framework that lets you train, fine-tune, and deploy AI models — from LLM fine-tuning to tabular classification — using a YAML config file and zero boilerplate Python.

  41. 44

    tensorzero

    11.7Ktensorzero/tensorzero · Rust

    TensorZero is an open-source LLMOps platform that combines an LLM gateway, observability, evaluation, optimization, and experimentation tooling into one self-hosted stack.

  42. 45

    qlora

    11Kartidoro/qlora · Jupyter Notebook

    QLoRA is a research method and code release for efficiently finetuning large quantized language models. It backpropagates gradients through a frozen 4-bit quantized model into small LoRA adapters, cutting memory use enough to finetune a 65B model on a single 48GB GPU while matching full 16-bit finetuning quality.

  43. 46

    llama-gpt

    10.9Kgetumbrel/llama-gpt · TypeScript

    LlamaGPT is a self-hosted, offline, ChatGPT-like chatbot powered by Llama 2 (and now Code Llama), so you get a familiar chat UI without sending any data to a third-party cloud.

  44. 47

    minbpe

    10.8Kkarpathy/minbpe · Python

    minbpe is a minimal, clean implementation of the Byte Pair Encoding (BPE) algorithm that modern LLMs like GPT, Llama and Mistral use to train their tokenizers.

  45. 48

    chathub

    10.7Kchathub-dev/chathub · TypeScript

    ChatHub is a browser extension that puts many AI chatbots — ChatGPT, Gemini, Claude, Grok, DeepSeek and open-source models — into one app, so you can use them side by side.

  46. 49

    petals

    10.6Kbigscience-workshop/petals · Python

    Petals lets you run big open LLMs at home, BitTorrent-style: you join a public swarm that serves models like Llama 3.1 (405B), Mixtral (8x22B), Falcon (40B+) and BLOOM (176B) for inference and fine-tuning right from your desktop or Google Colab, up to 10x faster than offloading.

  47. 50

    Operit

    8.7KAAswordman/Operit · Kotlin

    Operit is an open-source AI agent platform for Android that connects cloud or local AI models to your phone's system, terminal, browser, files, and project workspaces so the AI can actually perform tasks like file management, coding, and device automation.

  48. 51

    dflash

    6.2Kz-lab/dflash · Python

    DFlash is a lightweight block diffusion model built for speculative decoding, drafting tokens in parallel blocks so a larger target LLM can verify them faster than generating one token at a time.

  49. 52

    higgsfield

    6.1Khiggsfield-ai/higgsfield · Jupyter Notebook

    Higgsfield is an open-source, fault-tolerant GPU orchestration system and machine learning framework for training huge models, from billions to trillions of parameters, such as LLMs.

  50. 53

    Bonsai-demo

    3.4KPrismML-Eng/Bonsai-demo · Shell

    Bonsai Demo is a local-inference demo for Bonsai 2 27B, a ternary-weight large language model that runs on a laptop or single GPU via llama.cpp or MLX, with chat, vision, and agentic tool-calling support out of the box.

  51. 54

    Ptero

    1.5KPtero-ai/Ptero · PHP

    Ptero is a free, open-source AI chat platform that gives instant access to multiple language models (DeepSeek V4, Llama 3.3, Qwen, MiniMax, Mistral) through one clean interface, with no signup required.

  52. 55

    ai-torture-chamber

    965terrafying/ai-torture-chamber · Python

    A research project that steers small open-weight language models into strong negative or positive emotional states and measures what they say and do. A live version runs at wirehead.agency.

  53. 56

    XRAG

    807DocAILab/XRAG · Python

    XRAG is a benchmarking framework that dissects and evaluates the foundational components of Retrieval-Augmented Generation (RAG) systems, such as retrievers, embeddings, and LLMs, to show how different configurations affect overall RAG performance.

  54. 57

    Offensive-Security-AI-Models

    691JoasASantos/Offensive-Security-AI-Models

    A curated list of open-weight, uncensored language models fine-tuned for offensive-security tasks like penetration testing, red teaming, and security research. The README documents over 20 models sourced from HuggingFace model cards as of September 2026.

  55. 58

    SCM

    486allenv0/SCM · TypeScript

    SCM (Screen Memories) is a macOS desktop app that runs deep AI search locally over every photo and every video frame in a chosen folder, letting you search by meaning, on-screen text, or spoken dialogue, all without the cloud.

  56. 59

    Ai-jailbreak

    476Quincunx33/Ai-jailbreak · JavaScript

    A curated collection of jailbreak prompts and exploit techniques that bypass the safety guardrails of both open-weight models (Gemma, Qwen, Llama, DeepSeek, Phi-4, Mistral) and frontier closed models (GPT-5.x, Gemini 3.x, Grok 4.x), documented for red-teaming and AI safety research.

  57. 60

    MoE4All

    291Headmaster218/MoE4All · Rust

    MoE4All is a portable Windows app that runs large Mixture-of-Experts (MoE) LLMs beyond what fits in VRAM by streaming expert weights between GPU VRAM, system RAM and SSD, built on a Vulkan-first Rust inference engine so consumer AMD (and other Vulkan) GPUs can run huge models locally.

  58. 61

    qxotic

    175qxoticai/qxotic · Java

    Qxotic is an open-source AI stack built specifically for the JVM, giving Java applications local AI inference — chat, vision, audio, embeddings, reranking and text-to-speech — without needing Python or ONNX.

Often tagged together