Topics / #inference

Inference projects on GitHub

Running trained models efficiently to generate predictions or tokens.

As of , the most-starred Inference projects on GitHub are transformers (167.8K stars), llama.cpp (131.4K stars) and DeepSeek-V3 (104.5K stars). GitHub.Locker tracks 327 Inference repositories with 4.3M stars combined. The fastest-growing on October 16 was Strata, with +718 stars in a day.

327Projects
4.3MStars in total
+5KStars in a day
Browse in the catalog →github.com/topics/inference ↗

Hot right now

Most stars gained in a day · Oct 16

+718

Strata

Niko1221/Strata · ★ 26.4K

Strata runs Qwen3.8-Flash-Next, a 125-billion-parameter AI model, on a normal gaming PC with one NVIDIA GPU (12-24GB VRAM) and 64GB of RAM, with a one-click installer for Windows and Linux.

+461

ruflo

ruvnet/ruflo · ★ 75.8K

Ruflo is an agent meta-harness for Claude Code and Codex: it adds 100+ specialized agents, coordinated swarms, self-learning memory, and cross-machine federation on top of those coding agents so they can collaborate instead of running solo.

+222

colibri

JustVugg/colibri · ★ 42.5K

Colibri is an open-source engine for running frontier mixture-of-experts (MoE) language models on hardware you already own — written in pure C with zero dependencies.

+217

Edge0

Edge0-AI/Edge0 · ★ 5.3K

Edge0 is an open-source streaming MoE (Mixture-of-Experts) inference framework that lets you run large MoE models, like a 35B-parameter model, using only about 2.5-2.9 GB of active RAM by streaming expert weights from SSD and predicting routing one step ahead.

The all-time top

Top 100 of 327 · by stars

  1. #1 · huggingface/transformers

    transformers

    Transformers is Hugging Face's model-definition framework for state-of-the-art machine learning models across text, vision, audio, video, and multimodal tasks, usable for both inference and training.

    167.8K
  2. #2 · ggml-org/llama.cpp

    llama.cpp

    llama.cpp is a plain C/C++ implementation for running LLM (and VLM) inference with minimal setup and state-of-the-art performance, either locally or in the cloud.

    131.4K
  3. #3 · deepseek-ai/DeepSeek-V3

    DeepSeek-V3

    DeepSeek-V3 is an open-weight Mixture-of-Experts (MoE) language model with 671B total parameters but only 37B activated per token, built for efficient yet high-performing inference and matching leading closed-source models on many benchmarks.

    104.5K
  1. 4

    vllm

    94Kvllm-project/vllm · Python

    vLLM is a library for fast LLM inference and serving, built around PagedAttention for efficient memory management of attention keys and values.

  2. 5

    DeepSeek-R1

    91.9Kdeepseek-ai/DeepSeek-R1

    DeepSeek-R1 is an open-source family of reasoning-focused large language models from DeepSeek, trained with large-scale reinforcement learning to handle math, code, and general reasoning at a level comparable to OpenAI's o1.

  3. 6

    ruflo

    75.8Kruvnet/ruflo · TypeScript

    Ruflo is an agent meta-harness for Claude Code and Codex: it adds 100+ specialized agents, coordinated swarms, self-learning memory, and cross-machine federation on top of those coding agents so they can collaborate instead of running solo.

  4. 7

    llama

    59.6Kmeta-llama/llama · Python

    This is Meta's reference inference code for running Llama 2 language models (7B to 70B parameters) locally, letting you load pre-trained or chat fine-tuned weights and generate text completions.

  5. 8

    nanochat

    58.7Kkarpathy/nanochat · Python

    A minimal, hackable harness for training your own LLM end to end (tokenization, pretraining, finetuning, evaluation, inference) on a single GPU node, ending in a chatbot you talk to over a CLI.

  6. 9

    yolov5

    58.2Kultralytics/yolov5 · Python

    YOLOv5 is a fast, accurate, and easy-to-use computer vision model from Ultralytics for object detection, instance segmentation, and image classification, built on PyTorch.

  7. 10

    segment-anything

    55Kfacebookresearch/segment-anything · Jupyter Notebook

    This is Meta AI's Segment Anything Model (SAM), a foundation model that produces object masks for images from prompts like points or boxes, or automatically generates masks for every object in an image.

  8. 11

    whisper.cpp

    54.4Kggml-org/whisper.cpp · C++

    whisper.cpp is a high-performance C/C++ port of OpenAI's Whisper automatic speech recognition (ASR) model, letting you transcribe audio to text without Python or heavy ML frameworks.

  9. 12

    grok-1

    52.2Kxai-org/grok-1 · Python

    Grok-1 is the 314B-parameter Mixture-of-Experts language model that xAI opened up; this repository holds the JAX example code for loading and running it.

  10. 13

    exo

    47.9Kexo-explore/exo · Python

    exo turns a group of your own devices (Macs, Linux boxes) into a single AI cluster so you can run large AI models that would never fit on one machine, pooling their memory and compute together.

  11. 14

    jan

    45Kjanhq/jan · Rust

    Jan is an open-source, self-hosted alternative to ChatGPT that runs 100% offline on your own computer, letting you download and run LLMs locally with full control and privacy.

  12. 15

    DeepSpeed

    43.2Kdeepspeedai/DeepSpeed · Python

    DeepSpeed is a deep learning optimization library that makes distributed training and inference of very large models easy, efficient and effective — it powered models like MT-530B and BLOOM.

  13. 16

    colibri

    42.5KJustVugg/colibri · C

    Colibri is an open-source engine for running frontier mixture-of-experts (MoE) language models on hardware you already own — written in pure C with zero dependencies.

  14. 17

    ColossalAI

    41.4Khpcaitech/ColossalAI · Python

    Colossal-AI is an open-source system for training and running large AI models more cheaply, faster and with less hardware, by providing a toolbox of parallelism and memory-optimization techniques.

  15. 18

    BitNet

    41.2Kmicrosoft/BitNet · C++

    bitnet.cpp is Microsoft's official inference framework for 1-bit (ternary, 1.58-bit) large language models like BitNet b1.58, letting them run fast on CPUs and GPUs.

  16. 19

    ChatTTS

    39.9K2noise/ChatTTS · Python

    ChatTTS is an open-source text-to-speech model built for conversational speech — the natural-sounding voice layer for things like LLM assistants — speaking English and Chinese.

  17. 20

    FastChat

    39.5Klm-sys/FastChat · Python

    FastChat is an open platform for training, serving, and evaluating large language model based chatbots. It is the release repo for Vicuna and powers Chatbot Arena (lmarena.ai), which has served over 10 million chat requests for 70+ LLMs.

  18. 21

    airllm

    39.1Klyogavin/airllm · Jupyter Notebook

    An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

  19. 22

    GFPGAN

    37.7KTencentARC/GFPGAN · Python

    GFPGAN is a practical algorithm for real-world blind face restoration: it rebuilds degraded or low-quality faces in photos using rich priors from a pretrained face GAN like StyleGAN2.

  20. 23

    mediapipe

    37.3Kgoogle-ai-edge/mediapipe · C++

    Google's open-source, cross-platform toolkit for on-device machine learning in live and streaming media: ready-made libraries and pre-trained models you plug straight into your own app.

  21. 24

    sglang

    37.2Ksgl-project/sglang · Python

    SGLang is a high-performance serving framework for large language models and multimodal models, built to deliver low-latency, high-throughput inference from a single GPU up to large distributed clusters.

  22. 25

    pytorch-image-models

    37.2Khuggingface/pytorch-image-models · Python

    PyTorch Image Models (timm) — the largest collection of PyTorch image encoders and backbones, shipped with pretrained weights plus train, eval, inference and export scripts.

  23. 26

    diffusers

    34.7Khuggingface/diffusers · Python

    Diffusers is Hugging Face's Python library for state-of-the-art pretrained diffusion models that generate images, audio, and even 3D molecule structures, all in PyTorch.

  24. 27

    timesfm

    34.6Kgoogle-research/timesfm · Python

    TimesFM is a pretrained time-series foundation model from Google Research used for time-series forecasting, similar in spirit to a language model but for numerical sequences.

  25. 28

    openpose

    34.5KCMU-Perceptual-Computing-Lab/openpose · C++

    OpenPose is a real-time multi-person keypoint detection library: it detects 135 body, hand, face, and foot keypoints from images and video - the first system to detect all four jointly in real time.

  26. 29

    CLIP

    34.5Kopenai/CLIP · Jupyter Notebook

    CLIP is a neural network trained on many (image, text) pairs: given an image, it predicts the most relevant text snippet in natural language, zero-shot, without directly optimizing for the task.

  27. 30

    laya

    33.2KNandhaKishorM/laya · Python

    Laya is a non-autoregressive decision engine: instead of generating text, it answers typed questions — multiple choice, a numeric score, or yes/no — about any text in a single forward pass, across 100+ languages. A built-in router detects the language and picks the right checkpoint per request.

  28. 31

    fish-speech

    33.2Kfishaudio/fish-speech · Python

    Fish Speech (Fish Audio S2) is a state-of-the-art open-source text-to-speech system that generates natural, emotionally rich speech in 80+ languages, led by the flagship S2-Pro model that combines a Dual-AR architecture with reinforcement-learning alignment.

  29. 32

    DeepFaceLive

    31Kiperov/DeepFaceLive · Python

    DeepFaceLive is a Windows desktop app for real-time face swap: it replaces the face from your webcam — or the face in a video — with a trained face model, aimed at PC streaming and video calls.

  30. 33

    modular

    30Kmodular/modular · Mojo

    The open-source home of the Modular Platform for AI development and deployment — it hosts the MAX Framework and the Mojo programming language, with more components being open-sourced over time.

  31. 34

    Open-Sora

    29.9Khpcaitech/Open-Sora · Python

    Open-Sora is an open-source initiative for efficiently producing high-quality video: it releases video generation models together with the tools, checkpoints and all training details.

  32. 35

    llama3

    29.2Kmeta-llama/llama3 · Python

    Meta's official GitHub home for Llama 3: model weights plus minimal code for running inference on pre-trained and instruction-tuned models in 8B and 70B sizes. The repo is now deprecated.

  33. 36

    cs249r_book

    29Kharvard-edge/cs249r_book · Python

    An open textbook and full curriculum on Machine Learning Systems — AI engineering — from Harvard's CS249r course: four volumes covering foundations, scaling, agentic AI, and physical AI, plus labs, projects, and instructor materials.

  34. 37

    mlx

    28.8Kml-explore/mlx · C++

    MLX is an array framework for machine learning on Apple silicon, built by Apple's machine learning research team.

  35. 38

    so-vits-svc

    28.1Ksvc-develop-team/so-vits-svc · Python

    An open-source AI singing voice conversion (SVC) framework: it trains PyTorch models that make one voice sing the lines of another, using SoftVC speech features fed into VITS with an NSF-HiFiGAN vocoder.

  36. 39

    Qwen3

    27.7KQwenLM/Qwen3 · Python

    Qwen3 is a series of open-weight large language models built by the Qwen team at Alibaba Cloud, released as both dense and Mixture-of-Experts (MoE) models from 0.6B up to 235B-A22B parameters, with switchable 'thinking' and 'non-thinking' reasoning modes.

  37. 40

    Unlimited-OCR

    27.7Kbaidu/Unlimited-OCR · Python

    It's an open-source OCR model from Baidu built for one-shot parsing of long documents — the team positions it as pushing Deepseek-OCR one step further, with an arXiv paper backing the approach.

  38. 41

    Awesome-LLM

    27.4KHannibal046/Awesome-LLM

    A curated, continuously updated list of resources about Large Language Models (LLMs): milestone and other research papers, training/inference frameworks, open LLM checkpoints, benchmarks, courses, and books.

  39. 42

    DeepSpeech

    26.8Kmozilla/DeepSpeech · C++

    Mozilla DeepSpeech is an open-source Speech-To-Text engine — a machine-learning model that turns audio into text on your own hardware.

  40. 43

    Strata

    26.4KNiko1221/Strata · C++

    Strata runs Qwen3.8-Flash-Next, a 125-billion-parameter AI model, on a normal gaming PC with one NVIDIA GPU (12-24GB VRAM) and 64GB of RAM, with a one-click installer for Windows and Linux.

  41. 44

    Open-AutoGLM

    26.4Kzai-org/Open-AutoGLM · Python

    Open-AutoGLM (Phone Agent) is an open phone-use agent framework built on the AutoGLM model that understands your phone screen visually and automates tasks via natural-language commands like 'open Xiaohongshu and search for food'.

  42. 45

    llamafile

    26.4Kmozilla-ai/llamafile · C++

    llamafile turns open LLMs into single-file executables: one file that runs a chat model locally on most operating systems and CPU architectures, with no installation. It is a Mozilla Builders project, now revamped by Mozilla.ai.

  43. 46

    faster-whisper

    25.9KSYSTRAN/faster-whisper · Python

    A Python reimplementation of OpenAI's Whisper model on CTranslate2, a fast Transformer inference engine — up to 4x faster than the original at the same accuracy, using less memory, with optional 8-bit quantization on CPU and GPU.

  44. 47

    JARVIS

    25.4Kmicrosoft/JARVIS · Python

    JARVIS is an open-source research system that connects an LLM with the ML community: a large language model acts as the controller, picking and invoking expert models from the Hugging Face Hub to solve complex AI tasks.

  45. 48

    flash-attention

    25.1KDao-AILab/flash-attention · Python

    The official implementation of FlashAttention and FlashAttention-2 — GPU kernels that compute exact attention faster and with less memory than standard PyTorch attention.

  46. 49

    LLaVA

    25.1Khaotian-liu/LLaVA · Python

    LLaVA is an open-source large multimodal chatbot: a vision-language model you can show images to and talk with, built by visual instruction tuning toward GPT-4V-level capabilities (NeurIPS 2023 Oral).

  47. 50

    gallery

    25Kgoogle-ai-edge/gallery · Kotlin

    Google AI Edge Gallery is an app that lets you download and run open-source generative AI models, including the Gemma family, directly on your Android phone, iPhone, or Mac — fully offline.

  48. 51

    index-tts

    24.5Kindex-tts/index-tts · Python

    IndexTTS is a zero-shot text-to-speech system that clones a voice from a single reference audio clip. The latest version, IndexTTS-2.5, supports Chinese, English, Japanese, Spanish and Arabic with fine-grained emotion, speed and pronunciation control.

  49. 52

    DeepSeek-Coder

    24.3Kdeepseek-ai/DeepSeek-Coder · Python

    DeepSeek Coder is a family of open-source code language models trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese), built for code generation, completion, and infilling.

  50. 53

    CosyVoice

    24KQwenAudio/CosyVoice · Python

    CosyVoice is Alibaba's open-source, LLM-based text-to-speech system. It generates natural speech in 9 languages plus 18+ Chinese dialects, supports zero-shot voice cloning, and ships inference, training and deployment code.

  51. 54

    ncnn

    24KTencent/ncnn · C++

    ncnn is a high-performance neural network inference framework built by Tencent and optimized for mobile, embedded, and desktop deployment. It is used in Tencent apps like QQ, Qzone, and WeChat to run deep learning models on-device.

  52. 55

    mlc-llm

    23.2Kmlc-ai/mlc-llm · Python

    MLC LLM is a machine learning compiler and high-performance deployment engine that lets you run large language models natively on almost any platform, from servers to phones to the browser.

  53. 56

    omlx

    22.9Kjundot/omlx · Python

    oMLX is a local LLM inference server for Apple Silicon Macs. It serves text LLMs, vision models, OCR, embeddings and rerankers with continuous batching and a tiered KV cache, managed from the macOS menu bar.

  54. 57

    NemoClaw

    22.8KNVIDIA/NemoClaw · TypeScript

    An open source reference stack from NVIDIA for running AI agents like OpenClaw, Hermes and LangChain Deep Agents more safely inside NVIDIA OpenShell sandboxes, with managed inference, network policy and lifecycle operations via its CLI.

  55. 58

    onnxruntime

    22.1Kmicrosoft/onnxruntime · C++

    ONNX Runtime is a cross-platform, high performance ML accelerator for inference and training. It runs models from PyTorch, TensorFlow/Keras and classical ML libraries like scikit-learn, LightGBM and XGBoost.

  56. 59

    Qwen

    21.9KQwenLM/Qwen · Python

    The official repo of Qwen (通义千问, Tongyi Qianwen) — Alibaba Cloud's family of chat and pretrained large language models, released in sizes from 1.8B up to 72B parameters on Hugging Face and ModelScope.

  57. 60

    serve

    21.9Kjina-ai/serve · Python

    Jina is an open-source Python framework for building multimodal AI applications on a cloud-native stack — you wrap models into gRPC microservices, chain them into flows, and scale from local to cloud.

  58. 61

    guidance

    21.8Kguidance-ai/guidance · Jupyter Notebook

    Guidance is a Python library — an efficient programming paradigm for steering large language models: you control how output is structured while reducing latency and cost compared with conventional prompting or fine-tuning.

  59. 62

    peft

    21.8Khuggingface/peft · Python

    Hugging Face's library of Parameter-Efficient Fine-Tuning methods: you adapt a large pretrained model by training only a small number of extra parameters instead of all of them, which slashes compute and storage costs.

  60. 63

    onnx

    21.6Konnx/onnx · Python

    ONNX (Open Neural Network Exchange) is an open standard for machine learning interoperability — an open ecosystem and format for AI models, both deep learning and traditional ML.

  61. 64

    surya

    21.5Kdatalab-to/surya · Python

    Surya is Datalab's open-source document OCR system built around a 650M parameter model. It reads text from images and PDFs, and also does layout analysis, reading order, and table recognition.

  62. 65

    FinGPT

    21.4KAI4Finance-Foundation/FinGPT · Jupyter Notebook

    FinGPT is AI4Finance Foundation's open-source project for financial large language models: trained models are released on HuggingFace, with code for RAG, fine-tuning pipelines and benchmarks built around them.

  63. 66

    candle

    21.2Khuggingface/candle · Rust

    Candle is a minimalist machine learning framework for Rust, focused on performance (including GPU support) and ease of use. It ships with ready examples for LLMs, speech, vision and text-to-image models.

  64. 67

    mxnet

    20.8Kapache/mxnet · C++

    Apache MXNet is a deep learning framework designed for both efficiency and flexibility: it lets you mix symbolic and imperative programming, and a dynamic dependency scheduler automatically parallelizes operations on the fly.

  65. 68

    gpt-oss

    20.5Kopenai/gpt-oss · Python

    The gpt-oss series: two open-weight language models from OpenAI — gpt-oss-120b and gpt-oss-20b — built for powerful reasoning, agentic tasks, and versatile developer use cases. The repo itself adds reference implementations, tools, and example clients around the models.

  66. 69

    llama2.c

    20.2Kkarpathy/llama2.c · C

    It's a minimal project to train a small Llama 2 model in PyTorch and then run inference on it using a single pure C file, with no dependencies.

  67. 70

    ktransformers

    19.6Kkvcache-ai/ktransformers · Python

    KTransformers is a research framework for efficient inference and fine-tuning of large language models through CPU-GPU heterogeneous computing, letting huge MoE models run on hardware that doesn't have enough VRAM to hold them entirely on GPU.

  68. 71

    ml-engineering

    19.5Kstas00/ml-engineering · Python

    An open book on machine learning engineering: methodologies, tools and step-by-step instructions for training, fine-tuning and running inference on large language models and multi-modal (VLM) models, written by the engineer who led the BLOOM-176B training.

  69. 72

    dia

    19.4Knari-labs/dia · Python

    Dia is a 1.6B-parameter open-weights text-to-speech model from Nari Labs that generates ultra-realistic multi-speaker dialogue from a transcript in a single pass.

  70. 73

    web-llm

    19.3Kmlc-ai/web-llm · TypeScript

    WebLLM runs large language models directly in the browser, accelerated by WebGPU — no server involved. It exposes the OpenAI API, so standard OpenAI-style code works against open models running locally.

  71. 74

    LivePortrait

    19.3KKlingAIResearch/LivePortrait · Python

    LivePortrait animates a still portrait photo using a driving video — the official PyTorch implementation of the paper 'Efficient Portrait Animation with Stitching and Retargeting Control' by Kuaishou Technology. It works on humans as well as cats and dogs.

  72. 75

    tfjs

    19.1Ktensorflow/tfjs · TypeScript

    An open-source, hardware-accelerated JavaScript library for training and deploying machine learning models in the browser and in Node.js.

  73. 76

    Chinese-LLaMA-Alpaca

    18.9Kymcui/Chinese-LLaMA-Alpaca · Python

    Open-source Chinese LLaMA and Alpaca large language models. The base LLaMA was extended with a Chinese vocabulary and further pre-trained on Chinese data, and Alpaca versions were instruction-tuned on Chinese instructions; training and deployment scripts are open too.

  74. 77

    mamba

    18.9Kstate-spaces/mamba · Python

    Mamba is a state space model architecture for sequence modeling with linear-time scaling. It shows promising performance on information-dense data like language modeling, where earlier subquadratic models fell short of Transformers; this repo is its PyTorch implementation.

  75. 78

    alpaca-lora

    18.9Ktloen/alpaca-lora · Jupyter Notebook

    Alpaca-LoRA reproduces the Stanford Alpaca results by instruct-tuning LLaMA with low-rank adaptation (LoRA). It ships the training code, inference scripts, and the resulting LoRA weights, producing an Instruct model of similar quality to text-davinci-003.

  76. 79

    magika

    18.7Kgoogle/magika · Rust

    Magika is an AI-powered file type detection tool: a small deep learning model (a few MB) identifies what a file actually is within milliseconds, even on a single CPU.

  77. 80

    Speech

    18.6KNVIDIA-NeMo/Speech · Python

    An open-source NVIDIA framework for building speech AI models — automatic speech recognition (ASR), text-to-speech (TTS), and speech LLMs — with pre-trained checkpoints you can customize and deploy.

  78. 81

    llama-cookbook

    18.6Kmeta-llama/llama-cookbook · Jupyter Notebook

    The Llama Cookbook — Meta's official collection of recipes for building with the Llama model family: inference, fine-tuning, RAG and end-to-end use cases, mostly written as Jupyter notebooks.

  79. 82

    lingbot-map

    18.1KRobbyant/lingbot-map · Python

    LingBot-Map is a feed-forward 3D foundation model for streaming 3D reconstruction, built around a Geometric Context Transformer that was a ECCV 2026 Best Paper Award candidate.

  80. 83

    Wan2.2

    18KWan-Video/Wan2.2 · Python

    An open-source family of large-scale video generation models: text-to-video, image-to-video, speech-to-video and character animation, with inference code and model weights released under Apache-2.0.

  81. 84

    Qwen3-Coder

    16.8KQwenLM/Qwen3-Coder · Python

    Qwen3-Coder is the code-focused branch of the Qwen3 large language model family from the Qwen team — open-weight models built for coding and agentic tasks, available in several sizes.

  82. 85

    transformers.js

    16.3Khuggingface/transformers.js · JavaScript

    Transformers.js lets you run Hugging Face's state-of-the-art machine learning models directly in a web browser, with no server required, using an API designed to mirror the Python transformers library.

  83. 86

    MNN

    16.2Kalibaba/MNN · C++

    MNN is a lightweight, high-performance deep learning inference (and training) engine built by Alibaba, used to run models like LLMs, diffusion models, and CNNs efficiently on mobile, embedded, and edge devices.

  84. 87

    codellama

    16.2Kmeta-llama/codellama · Python

    This is Meta's official inference code for Code Llama, a family of large language models for code built on Llama 2. The repo itself is a minimal example for loading the models and running generation.

  85. 88

    burn

    16.1Ktracel-ai/burn · Rust

    Burn is a Rust tensor library and deep learning framework for both training and inference, so the same code takes a model from prototype to production on everything from GPU clusters to the browser.

  86. 89

    stable-diffusion-webui-colab

    15.9Kcamenduru/stable-diffusion-webui-colab · Jupyter Notebook

    A set of ready-made Google Colab notebooks that install and run the Stable Diffusion WebUI in the cloud — one notebook per popular model, from SD 1.5 to waifu-diffusion and style fine-tunes.

  87. 90

    nano-vllm

    15.9KGeeeekExplorer/nano-vllm · Python

    Nano-vLLM is a lightweight, from-scratch reimplementation of the vLLM inference engine for running large language models, built in roughly 1,200 lines of readable Python.

  88. 91

    ms-swift

    15.9Kmodelscope/ms-swift · Python

    ms-swift is the ModelScope community's fine-tuning and deployment framework for LLMs and multimodal models, covering training, inference, evaluation, quantization and deployment in one pipeline.

  89. 92

    Second-Me

    15.7Kmindverse/Second-Me · Python

    Second Me is an open-source project that lets you train a personal, locally-hosted AI model that preserves your identity, memory, and context, then connects it to a decentralized network so it can represent you across apps.

  90. 93

    ChatGLM2-6B

    15.5Kzai-org/ChatGLM2-6B · Python

    ChatGLM2-6B is an open bilingual (Chinese-English) conversational language model with 6 billion parameters, the second generation of ChatGLM-6B from Zhipu AI (Z.ai).

  91. 94

    ggml

    15.5Kggml-org/ggml · C++

    ggml is a plain C/C++ tensor library built for running machine learning models with minimal setup, no external dependencies, and support for CPU, GPU, NPU, and browser backends. It's the core engine that powers projects like llama.cpp.

  92. 95

    ts-pattern

    15.2Kgvergnaud/ts-pattern · TypeScript

    TS-Pattern is an exhaustive pattern matching library for TypeScript, letting you express complex conditions as a single compact expression instead of nested if/else or switch statements, with the type checker narrowing types for you.

  93. 96

    OpenMythos

    14.9Kkyegomez/OpenMythos · Python

    OpenMythos is an open-source, speculative PyTorch implementation that tries to reconstruct the internal architecture of Anthropic's Claude ('Mythos') purely from publicly available research papers, not from any leaked or official Anthropic code.

  94. 97

    tortoise-tts

    14.9Kneonbjb/tortoise-tts · Jupyter Notebook

    Tortoise is a text-to-speech system built with an emphasis on quality: strong multi-voice capabilities and highly realistic prosody and intonation. This repo contains everything needed to run it in inference mode.

  95. 98

    TensorRT-LLM

    14.8KNVIDIA/TensorRT-LLM · Python

    TensorRT LLM is NVIDIA's Python framework for defining large language models (and now visual generation models) and compiling them into highly optimized inference engines that run on NVIDIA GPUs, with specialized kernels and Python/C++ runtimes.

  96. 99

    Llama-Chinese

    14.8KLlamaChinese/Llama-Chinese · Python

    Llama-Chinese is a Chinese-language community project built around Meta's Llama models (Llama2, Llama3, Llama4). It provides Chinese pretraining and fine-tuning, a custom Atom model series optimized for Chinese, and resources for training, deploying and using Llama in Chinese for free commercial use.

  97. 100

    RWKV-LM

    14.8KBlinkDL/RWKV-LM · Python

    RWKV (pronounced 'RwaKuv') is an RNN architecture with transformer-level LLM performance that can also be trained in parallel like GPT. The current generation, RWKV-7 'Goose', is 100% attention-free, linear-time and constant-memory (no kv-cache).

Showing the 100 most-starred of 327. See every one in the catalog.

Often tagged together