Topics / #consumer-gpu

Consumer GPU projects on GitHub

Running AI workloads on consumer-grade GPUs

As of , the most-starred Consumer GPU projects on GitHub are airllm (39.2K stars), Wan2.1 (17.2K stars) and Soup (9.3K stars). GitHub.Locker tracks 6 Consumer GPU repositories with 71.1K stars combined. The fastest-growing on October 17 was airllm, with +160 stars in a day.

6Projects
71.1KStars in total
+300Stars in a day
Browse in the catalog →github.com/topics/consumer-gpu ↗

Hot right now

Most stars gained in a day · Oct 17

+160

airllm

lyogavin/airllm · ★ 39.2K

An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

+81

Soup

MakazhanAlpamys/Soup · ★ 9.3K

Soup is a command-line tool for fine-tuning and post-training LLMs from a single YAML config file, automating GPU detection, batching and quantization so you just write a config and run one command.

+42

FreeVideo

FlashML-org/FreeVideo · ★ 2.1K

FreeVideo is a local inference engine that lets you run the MiniMax H3 video generation model on your own consumer GPU instead of a cloud service, adapting its memory and compute strategy to your hardware.

+6

HyperQwen

syv-ai/HyperQwen · ★ 2.1K

HyperQwen is a self-hosted serving setup that runs the Qwen3.8-27B model on a single 24 GB consumer GPU (like an RTX 3090) using vLLM, exposing it through an OpenAI-compatible API.

The all-time top

6 projects · by stars

  1. #1 · lyogavin/airllm

    airllm

    An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

    39.2K
  2. #2 · Wan-Video/Wan2.1

    Wan2.1

    Wan2.1 is an open suite of large-scale video generative models: it turns text or images into videos, and also covers video editing, text-to-image and video-to-audio tasks.

    17.2K
  3. #3 · MakazhanAlpamys/Soup

    Soup

    Soup is a command-line tool for fine-tuning and post-training LLMs from a single YAML config file, automating GPU detection, batching and quantization so you just write a config and run one command.

    9.3K
  1. 4

    FreeVideo

    2.1KFlashML-org/FreeVideo · Python

    FreeVideo is a local inference engine that lets you run the MiniMax H3 video generation model on your own consumer GPU instead of a cloud service, adapting its memory and compute strategy to your hardware.

  2. 5

    HyperQwen

    2.1Ksyv-ai/HyperQwen · Python

    HyperQwen is a self-hosted serving setup that runs the Qwen3.8-27B model on a single 24 GB consumer GPU (like an RTX 3090) using vLLM, exposing it through an OpenAI-compatible API.

  3. 6

    mini-AGI

    1.3Kvolotat/mini-AGI · Python

    mini-AGI is a continual learning, byte-level language model that assembles its own architecture, trains from scratch on a single 8GB VRAM GPU, and keeps learning from everything it reads, without a separate fine-tuning phase.

Often tagged together