Topics / #language-model

Language-model projects on GitHub

Statistical and neural models that predict and generate language.

As of , the most-starred Language-model projects on GitHub are generative-ai-for-beginners (121.5K stars), LLMs-from-scratch (106.7K stars) and Prompt-Engineering-Guide (79.2K stars). GitHub.Locker tracks 53 Language-model repositories with 1.1M stars combined. The fastest-growing on October 16 was Edge0, with +217 stars in a day.

53Projects
1.1MStars in total
+750Stars in a day
Browse in the catalog →github.com/topics/language-model ↗

Hot right now

Most stars gained in a day · Oct 16

+217

Edge0

Edge0-AI/Edge0 · ★ 5.3K

Edge0 is an open-source streaming MoE (Mixture-of-Experts) inference framework that lets you run large MoE models, like a 35B-parameter model, using only about 2.5-2.9 GB of active RAM by streaming expert weights from SSD and predicting routing one step ahead.

+71

qingjian

qingjian-team/qingjian · ★ 6.7K

Qingjian is a pinyin input method (IME) written in Rust for macOS, Windows, and Linux. Next to each candidate word it shows a translation in a language you're learning (English, Japanese, or Spanish), so language learning happens passively while you type normally.

+65

LLMs-from-scratch

rasbt/LLMs-from-scratch · ★ 106.7K

This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

+59

generative-ai-for-beginners

microsoft/generative-ai-for-beginners · ★ 121.5K

A 21-lesson course by Microsoft Cloud Advocates that teaches the fundamentals of building Generative AI applications, covering concepts like prompt engineering, chat apps, RAG, fine-tuning, and AI agents.

The all-time top

53 projects · by stars

  1. #1 · microsoft/generative-ai-for-beginners

    generative-ai-for-beginners

    A 21-lesson course by Microsoft Cloud Advocates that teaches the fundamentals of building Generative AI applications, covering concepts like prompt engineering, chat apps, RAG, fine-tuning, and AI agents.

    121.5K
  2. #2 · rasbt/LLMs-from-scratch

    LLMs-from-scratch

    This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

    106.7K
  3. #3 · dair-ai/Prompt-Engineering-Guide

    Prompt-Engineering-Guide

    This is DAIR.AI's Prompt Engineering Guide: a large, continuously updated collection of guides, papers, lecture notes, and notebooks covering prompt engineering techniques, context engineering, retrieval-augmented generation (RAG), and building AI agents with LLMs.

    79.2K
  1. 4

    gpt4free

    66.9Kxtekky/gpt4free · Python

    GPT4Free (g4f) is a community-driven project that aggregates many free and reverse-engineered access points to commercial LLMs (GPT-4, Claude, Gemini, DeepSeek, etc.) and media-generation models, exposing them through one unified Python/JS client, web GUI, and OpenAI-compatible API.

  2. 5

    llama

    59.6Kmeta-llama/llama · Python

    This is Meta's reference inference code for running Llama 2 language models (7B to 70B parameters) locally, letting you load pre-trained or chat fine-tuned weights and generate text completions.

  3. 6

    bert

    40Kgoogle-research/bert · Python

    Google's official TensorFlow implementation of BERT together with pre-trained checkpoints — a method for pre-training language representations that set state-of-the-art results on a wide range of NLP tasks, from SQuAD question answering to natural language inference.

  4. 7

    Open-Assistant

    37.4KLAION-AI/Open-Assistant · Python

    OpenAssistant was a community project to build a free, open chat-based assistant like ChatGPT, trained on crowdsourced instruction data and RLHF. The project has since wrapped up: the final 'oasst2' dataset is published on Hugging Face and the repo stands as a record of the effort.

  5. 8

    fairseq

    32.2Kfacebookresearch/fairseq · Python

    Fairseq is Facebook AI Research's sequence modeling toolkit for training custom models for translation, summarization, language modeling and other text generation tasks, built on PyTorch.

  6. 9

    stanford_alpaca

    30.2Ktatsu-lab/stanford_alpaca · Python

    Stanford's official Alpaca repo: code and docs for training an instruction-following LLaMA model and generating its 52K instruction dataset. In preliminary human evaluation the 7B model behaved similarly to text-davinci-003.

  7. 10

    repomix

    28.9Kyamadashy/repomix · TypeScript

    Repomix packs an entire repository into a single AI-friendly file you can feed to LLMs like Claude, ChatGPT, DeepSeek or Gemini — for code review, refactoring, docs or tests.

  8. 11

    ai

    27.4Kvercel/ai · TypeScript

    It's the AI SDK — a free, open-source TypeScript toolkit from Vercel (the Next.js team) for building AI-powered applications and agents with Next.js, React, Svelte, Vue, Angular and Node.js.

  9. 12

    open-r1

    26.5Khuggingface/open-r1 · Python

    Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.

  10. 13

    gpt-2

    25Kopenai/gpt-2 · Python

    This is OpenAI's official code and release for GPT-2, the language model described in the paper 'Language Models are Unsupervised Multitask Learners'. It bundles the model code with scripts to generate text samples from the released GPT-2 checkpoints.

  11. 14

    minGPT

    25Kkarpathy/minGPT · Python

    minGPT is a minimal PyTorch re-implementation of OpenAI's GPT, covering both training and inference, written to be small and easy to read rather than production-optimized.

  12. 15

    nn-zero-to-hero

    24.8Kkarpathy/nn-zero-to-hero · Jupyter Notebook

    A course by Andrej Karpathy that teaches neural networks from the absolute basics, built around a series of YouTube lectures with accompanying Jupyter notebooks coded live in the videos.

  13. 16

    mlc-llm

    23.2Kmlc-ai/mlc-llm · Python

    MLC LLM is a machine learning compiler and high-performance deployment engine that lets you run large language models natively on almost any platform, from servers to phones to the browser.

  14. 17

    web-llm

    19.3Kmlc-ai/web-llm · TypeScript

    WebLLM runs large language models directly in the browser, accelerated by WebGPU — no server involved. It exposes the OpenAI API, so standard OpenAI-style code works against open models running locally.

  15. 18

    DocsGPT

    18.3Karc53/DocsGPT · Python

    DocsGPT is a private, self-hosted AI platform for building agents, assistants, and enterprise search tools, with a built-in Agent Builder, document analysis, deep research mode, and support for multiple LLM providers.

  16. 19

    StableLM

    15.7KStability-AI/StableLM · Jupyter Notebook

    StableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.

  17. 20

    llama3-from-scratch

    15.2Knaklecha/llama3-from-scratch · Jupyter Notebook

    A Jupyter notebook that implements Llama3 entirely from scratch, building up every matrix multiplication by hand instead of calling pre-built transformer modules.

  18. 21

    RWKV-LM

    14.8KBlinkDL/RWKV-LM · Python

    RWKV (pronounced 'RwaKuv') is an RNN architecture with transformer-level LLM performance that can also be trained in parallel like GPT. The current generation, RWKV-7 'Goose', is 100% attention-free, linear-time and constant-memory (no kv-cache).

  19. 22

    lm-evaluation-harness

    14.2KEleutherAI/lm-evaluation-harness · Python

    It is a unified framework for few-shot evaluation of language models across a huge number of standard academic benchmarks.

  20. 23

    open_clip

    14.2Kmlfoundations/open_clip · Python

    OpenCLIP is an open source implementation of OpenAI's CLIP model for training and using contrastive image-text (and now audio-text) models for tasks like zero-shot classification.

  21. 24

    LoRA

    13.9Kmicrosoft/LoRA · Python

    LoRA (loralib) is Microsoft's reference implementation of the paper 'LoRA: Low-Rank Adaptation of Large Language Models'. It lets you fine-tune large models like GPT-2, RoBERTa and DeBERTa by training small low-rank matrices instead of all the original weights.

  22. 25

    speech-to-speech

    13.5Khuggingface/speech-to-speech · Python

    It's a low-latency, fully modular voice-agent pipeline (VAD -> STT -> LLM -> TTS) for building voice agents with open-source speech and language models, exposed over WebSocket and WebRTC via the OpenAI Realtime API event set.

  23. 26

    txtai

    13Kneuml/txtai · Python

    txtai is an all-in-one AI framework for semantic search, LLM orchestration and language model workflows. Its core is an embeddings database that combines vector indexes, graph networks and relational databases to power search or serve as a knowledge source for LLM apps.

  24. 27

    train-llm-from-scratch

    12.2KFareedKhan-dev/train-llm-from-scratch · Python

    A from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.

  25. 28

    char-rnn

    12.1Kkarpathy/char-rnn · Lua

    A multi-layer Recurrent Neural Network implementation (vanilla RNN, LSTM, GRU) in Torch/Lua for training and sampling character-level language models that learn to predict the next character in a text and can then generate new text that mimics it.

  26. 29

    speechbrain

    11.9Kspeechbrain/speechbrain · Python

    An open-source, PyTorch-based toolkit for Conversational AI — the technology behind speech assistants and chatbots. It bundles training recipes and pretrained models for a wide range of speech and text processing tasks.

  27. 30

    MiniCPM

    11.6KOpenBMB/MiniCPM · Jupyter Notebook

    MiniCPM is OpenBMB's family of small, open-source LLMs built for on-device and resource-constrained use. The newest release, MiniCPM5-2B, is a dense 2B-parameter model that reaches open-source state-of-the-art for its size class while staying competitive with much larger 4B-class models.

  28. 31

    PocketFlow

    11.3KThe-Pocket/PocketFlow · Python

    Pocket Flow is a minimalist 100-line LLM framework built around a single Graph abstraction, letting you build agents, workflows, and RAG pipelines without heavy dependencies or vendor lock-in.

  29. 32

    tokenizers

    11.2Khuggingface/tokenizers · Rust

    Tokenizers is a library implementing today's most-used tokenizers (BPE, WordPiece, Unigram) for NLP, built in Rust for speed and exposed to other languages via bindings. It's made by Hugging Face and powers tokenization for transformer models.

  30. 33

    Kimi-K2

    11.1KMoonshotAI/Kimi-K2

    Kimi K2 is a large language model series from Moonshot AI: a mixture-of-experts model with 1 trillion total parameters (32B activated per token), trained for frontier knowledge, reasoning, coding and especially agentic tool-use tasks.

  31. 34

    minbpe

    10.8Kkarpathy/minbpe · Python

    minbpe is a minimal, clean implementation of the Byte Pair Encoding (BPE) algorithm that modern LLMs like GPT, Llama and Mistral use to train their tokenizers.

  32. 35

    Chinese-BERT-wwm

    10.2Kymcui/Chinese-BERT-wwm · Python

    This project releases a family of pre-trained Chinese BERT models trained with Whole Word Masking (WWM), including BERT-wwm, BERT-wwm-ext, RoBERTa-wwm-ext, RoBERTa-wwm-ext-large, and smaller RBT3/RBT4/RBT6/RBTL3 variants, published alongside a paper in IEEE/ACM TASLP.

  33. 36

    LLMsPracticalGuide

    10.2KMooler0410/LLMsPracticalGuide

    A curated, actively updated list of practical guide resources for large language models (LLMs), covering models, data, NLP tasks, and usage restrictions. It is based on a survey paper 'Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond'.

  34. 37

    Kimi-K3

    8.9KMoonshotAI/Kimi-K3

    Kimi K3 is MoonshotAI's open-weight, native multimodal agentic model — a 2.8T-parameter Mixture-of-Experts system built for frontier-level long-horizon coding, agentic knowledge work, and reasoning.

  35. 38

    qingjian

    6.7Kqingjian-team/qingjian · Rust

    Qingjian is a pinyin input method (IME) written in Rust for macOS, Windows, and Linux. Next to each candidate word it shows a translation in a language you're learning (English, Japanese, or Spanish), so language learning happens passively while you type normally.

  36. 39

    SWE-bench

    6KSWE-bench/SWE-bench · Python

    SWE-bench is a benchmark that tests large language models on real GitHub issues: the model gets a codebase plus an issue and must produce a patch that resolves it. An automated harness scores the patches.

  37. 40

    Edge0

    5.3KEdge0-AI/Edge0 · Python

    Edge0 is an open-source streaming MoE (Mixture-of-Experts) inference framework that lets you run large MoE models, like a 35B-parameter model, using only about 2.5-2.9 GB of active RAM by streaming expert weights from SSD and predicting routing one step ahead.

  38. 41

    parameter-golf

    5.2Kopenai/parameter-golf · Python

    This is OpenAI's 'Model Craft Challenge: Parameter Golf' - a competition to train the best language model that fits in a 16MB artifact and trains in under 10 minutes on 8xH100 GPUs, scored by bits-per-byte compression on the FineWeb validation set.

  39. 42

    esp32-ai

    4.5KslvDev/esp32-ai · Python

    A 28.9 million parameter language model that runs text generation entirely on an ESP32-S3 microcontroller, with the generated text shown on a small screen wired to the chip.

  40. 43

    heartlib

    3.8KHeartMuLa/heartlib · Python

    HeartMuLa is a family of open-source music foundation models for generating music from lyrics and tags, shipped together with codec, transcription and audio-text retrieval companion models.

  41. 44

    bdh

    3.6Kpathwaycom/bdh · Python

    BDH (Dragon Hatchling) is a biologically inspired large language model architecture that connects deep learning with neuroscience, aiming to explain how reasoning and generalization emerge in AI systems at the level of individual neuron interactions.

  42. 45

    jailbreaks

    3.1Ktogg53192-cmd/jailbreaks

    This is a personal collection of jailbreak prompts meant to bypass the safety restrictions of AI chatbots like ChatGPT.

  43. 46

    Index-Translate

    1.6Kbilibili/Index-Translate · Python

    Index-Translate is a family of multilingual translation models built on Qwen3.5, covering text translation across 150 languages plus speech, syllable-controlled, and full-document translation variants.

  44. 47

    mini-AGI

    1.2Kvolotat/mini-AGI · Python

    mini-AGI is a continual learning, byte-level language model that assembles its own architecture, trains from scratch on a single 8GB VRAM GPU, and keeps learning from everything it reads, without a separate fine-tuning phase.

  45. 48

    decider

    1.2KMapika/decider · Python

    Decider is a family of language models fine-tuned from Qwen3.5 that don't generate text; instead they read a state plus a set of typed questions and return calibrated probability distributions for every question in one forward pass.

  46. 49

    ai-torture-chamber

    965terrafying/ai-torture-chamber · Python

    A research project that steers small open-weight language models into strong negative or positive emotional states and measures what they say and do. A live version runs at wirehead.agency.

  47. 50

    Spark-X2.5

    812XHToken/Spark-X2.5

    Spark-X2.5 is a series of two open-source language models (4B and 1.7B parameters) built for everyday conversation, writing, translation, coding, reasoning and agentic tool-use tasks, aiming for strong performance in a compact size.

  48. 51

    ai-system-design

    672amitshekhariitbhu/ai-system-design · Markdown

    A free, open-source guide that teaches AI System Design step by step: how to combine GPUs, inference servers, caches, vector databases, AI agents, guardrails, and evals into one system that is fast, cheap, reliable, and safe.

  49. 52

    OpenArch

    426anuj0456/OpenArch · Python

    A set of hand-written PyTorch implementations of modern open-source LLM architectures (Llama, Qwen, DeepSeek, Gemma, GPT-OSS, Kimi and more), written from scratch for readability and learning.

  50. 53

    cardputer-ai

    118therezor/cardputer-ai · C++

    Cardputer AI is a tiny offline chatbot that runs entirely on the M5Stack Cardputer / Cardputer ADV handheld, powered by an 8-million-parameter language model baked directly into the firmware.

Often tagged together