Topics / #diffusion

Diffusion projects on GitHub

Diffusion models that generate images and video from noise and prompts.

As of , the most-starred Diffusion projects on GitHub are stable-diffusion-webui (165.1K stars), ComfyUI (139.7K stars) and stable-diffusion (73.5K stars). GitHub.Locker tracks 45 Diffusion repositories with 977K stars combined. The fastest-growing on October 19 was ComfyUI, with +1.2K stars in a day.

45Projects
977KStars in total
+1.6KStars in a day
Browse in the catalog →github.com/topics/diffusion ↗

Hot right now

Most stars gained in a day · Oct 19

+1.2K

ComfyUI

Comfy-Org/ComfyUI · ★ 139.7K

ComfyUI is a node-based graph interface for building and running diffusion model workflows: image, video, 3D, and audio generation, editing, and more, all without writing code.

+164

sglang

sgl-project/sglang · ★ 37.5K

SGLang is a high-performance serving framework for large language models and multimodal models, built to deliver low-latency, high-throughput inference from a single GPU up to large distributed clusters.

+59

UniMate

Friedrich-M/UniMate · ★ 2K

UniMate is the official code release for a SIGGRAPH Asia 2026 paper: a single diffusion/flow-matching model that generates motion for very different skeleton types (bipedal, quadrupedal, avian, marine, insectoid, serpentine, and even rigid articulated objects) from a rigged 3D asset plus a text prompt, without retraining per skeleton.

+21

stable-diffusion-webui

AUTOMATIC1111/stable-diffusion-webui · ★ 165.1K

A browser-based interface for Stable Diffusion, built with the Gradio library, letting you generate and edit AI images (txt2img, img2img, inpainting, outpainting and more) on your own machine.

The all-time top

45 projects · by stars

  1. #1 · AUTOMATIC1111/stable-diffusion-webui

    stable-diffusion-webui

    A browser-based interface for Stable Diffusion, built with the Gradio library, letting you generate and edit AI images (txt2img, img2img, inpainting, outpainting and more) on your own machine.

    165.1K
  2. #2 · Comfy-Org/ComfyUI

    ComfyUI

    ComfyUI is a node-based graph interface for building and running diffusion model workflows: image, video, 3D, and audio generation, editing, and more, all without writing code.

    139.7K
  3. #3 · CompVis/stable-diffusion

    stable-diffusion

    Stable Diffusion is a latent text-to-image diffusion model that generates images from text prompts, built by CompVis with Stability AI and Runway, based on the Latent Diffusion Models work from CVPR '22.

    73.5K
  1. 4

    annotated_deep_learning_paper_implementations

    67.6Klabmlai/annotated_deep_learning_paper_implementations · Python

    A collection of 60+ PyTorch implementations of deep learning papers, each annotated with side-by-side explanatory notes so you can read the code and the math/explanation together.

  2. 5

    VibeVoice

    54.9Kmicrosoft/VibeVoice · Python

    VibeVoice is Microsoft's family of open-source voice AI models covering text-to-speech and speech recognition: long-form multi-speaker TTS, real-time streaming TTS, and ASR built for hour-long recordings.

  3. 6

    sglang

    37.5Ksgl-project/sglang · Python

    SGLang is a high-performance serving framework for large language models and multimodal models, built to deliver low-latency, high-throughput inference from a single GPU up to large distributed clusters.

  4. 7

    diffusers

    34.8Khuggingface/diffusers · Python

    Diffusers is Hugging Face's Python library for state-of-the-art pretrained diffusion models that generate images, audio, and even 3D molecule structures, all in PyTorch.

  5. 8

    ControlNet

    34.1Klllyasviel/ControlNet · Python

    ControlNet is a neural network structure that adds extra conditions to diffusion models like Stable Diffusion: instead of a text prompt alone, you steer generation with an edge map, depth map, pose skeleton or scribble. This repo is the official implementation.

  6. 9

    so-vits-svc

    28.1Ksvc-develop-team/so-vits-svc · Python

    An open-source AI singing voice conversion (SVC) framework: it trains PyTorch models that make one voice sing the lines of another, using SoftVC speech features fed into VITS with an NSF-HiFiGAN vocoder.

  7. 10

    generative-models

    27.3KStability-AI/generative-models · Python

    This is Stability AI's research codebase for a family of generative diffusion models, covering text-to-image (SDXL, SDXL-Turbo), image-to-video (Stable Video Diffusion), image-to-3D-video (SV3D), and video-to-4D (SV4D, SV4D 2.0) synthesis.

  8. 11

    flux

    26Kblack-forest-labs/flux · Python

    This is Black Forest Labs' official inference repo for the FLUX.1 family of image generation and editing diffusion models, providing minimal code to run the open-weight models.

  9. 12

    verl

    23.9Kverl-project/verl · Python

    verl is a flexible, efficient and production-ready reinforcement learning training library for LLMs, initiated by ByteDance's Seed team and maintained by the community. It is the open-source version of the HybridFlow paper (EuroSys 2025).

  10. 13

    IOPaint

    23.3KSanster/IOPaint · Python

    A free, open-source AI photo tool: it erases unwanted objects, defects, watermarks or people from pictures, and can replace or generate content with Stable Diffusion.

  11. 14

    peft

    21.8Khuggingface/peft · Python

    Hugging Face's library of Parameter-Efficient Fine-Tuning methods: you adapt a large pretrained model by training only a small number of extra parameters instead of all of them, which slashes compute and storage costs.

  12. 15

    sd-webui-controlnet

    17.8KMikubill/sd-webui-controlnet · Python

    An extension for AUTOMATIC1111's Stable Diffusion WebUI that adds ControlNet and other injection-based controls, guiding image generation with extra conditions like depth, poses or edges.

  13. 16

    FramePack

    17.3Klllyasviel/FramePack · Python

    FramePack is a next-frame-section prediction neural network for video diffusion, shipped as the official desktop app that turns an image and a short text prompt into a progressively generated video.

  14. 17

    leedl-tutorial

    16.8Kdatawhalechina/leedl-tutorial · Jupyter Notebook

    A free Chinese-language deep learning tutorial (nicknamed the 'Apple Book') based on Prof. Li Hongyi's (Hung-yi Lee) 'Machine Learning' course, covering most major deep learning topics in detail.

  15. 18

    F5-TTS

    15.4KSWivid/F5-TTS · Python

    F5-TTS is a text-to-speech system that generates fluent, faithful speech using flow matching with a Diffusion Transformer (ConvNeXt V2 backbone), and it supports cloning a speaker's voice from a short reference clip.

  16. 19

    AI-Scientist

    14.8KSakanaAI/AI-Scientist · Jupyter Notebook

    The AI Scientist is a system from Sakana AI that lets Large Language Models conduct open-ended scientific research fully automatically: generating ideas, running experiments, and writing up results as papers.

  17. 20

    DiffSynth-Studio

    13.3Kmodelscope/DiffSynth-Studio · Python

    DiffSynth-Studio is an open-source Diffusion model engine built and maintained by the ModelScope Community, covering image, video, and audio generation plus image quality metrics, with support for both inference and training.

  18. 21

    stable-diffusion-webui-forge

    13.1Klllyasviel/stable-diffusion-webui-forge · Python

    Stable Diffusion WebUI Forge is a platform built on top of Stable Diffusion WebUI (using Gradio) that adds GPU memory management and performance improvements for running Stable Diffusion image generation locally.

  19. 22

    magic-animate

    10.9Kmagic-research/magic-animate · Python

    This is the official codebase for 'MagicAnimate' (CVPR 2024), a diffusion-model method that animates a reference human image according to a motion sequence to produce temporally consistent video.

  20. 23

    StreamDiffusion

    10.8Kcumulo-autumn/StreamDiffusion · Python

    StreamDiffusion is a pipeline-level library for real-time, interactive diffusion image generation, letting you turn text prompts or a live webcam/screen feed into generated images at high frame rates.

  21. 24

    krita-ai-diffusion

    10.7KAcly/krita-ai-diffusion · Python

    A free, open-source Krita plugin that brings generative AI into painting and editing workflows: inpaint, outpaint, live-paint and upscale images with an optional text prompt, running on your own hardware.

  22. 25

    denoising-diffusion-pytorch

    10.7Klucidrains/denoising-diffusion-pytorch · Python

    A PyTorch implementation of the Denoising Diffusion Probabilistic Model (DDPM), a generative modeling approach the author positions as a possible rival to GANs.

  23. 26

    roomGPT

    10.7KNutlope/roomGPT · TypeScript

    RoomGPT lets you upload a photo of any room and generates an AI-redesigned version of it using a machine learning model.

  24. 27

    easydiffusion

    10.5Keasydiffusion/easydiffusion · JavaScript

    Easy Diffusion is a one-click way to run Stable Diffusion on your own PC: type a text prompt into its browser-based UI and get an image — no technical knowledge or pre-installed software needed.

  25. 28

    LTX-2

    9.8KLightricks/LTX-2 · Python

    The official Python package for LTX-2, Lightricks' audio-video foundation model: one DiT-based model that generates video with synchronized audio from text or an image, in several quality/speed modes.

  26. 29

    stable-diffusion.cpp

    7.7Kleejet/stable-diffusion.cpp · C++

    A pure C/C++ inference engine for diffusion models like Stable Diffusion, Flux, Wan, Qwen Image, and Z-Image, built the same way as llama.cpp so you can generate images and videos without heavy Python dependencies.

  27. 30

    vllm-omni

    7.3Kvllm-project/vllm-omni · Python

    vLLM-Omni is an inference and serving framework that extends vLLM beyond text-only LLMs to omni-modality models, handling text, image, audio, video, and action outputs.

  28. 31

    HunyuanVideo-1.5

    4.6KTencent-Hunyuan/HunyuanVideo-1.5 · Python

    HunyuanVideo-1.5 is a video generation model from Tencent that creates text-to-video and image-to-video clips, achieving top-tier quality with only 8.3B parameters so it runs on consumer-grade GPUs.

  29. 32

    PersonaLive

    4KGVCLab/PersonaLive · Python

    PersonaLive is a real-time, streamable diffusion framework that animates a single portrait image into an infinite-length talking video, designed for live-streaming use cases. It was accepted to CVPR 2026.

  30. 33

    kimodo

    3.8Knv-tlabs/kimodo · Python

    Kimodo is NVIDIA's kinematic motion diffusion model that generates high-quality 3D human and robot motion from text prompts and kinematic constraints like keyframes, end-effector positions, and 2D paths.

  31. 34

    UniMate

    2KFriedrich-M/UniMate · Python

    UniMate is the official code release for a SIGGRAPH Asia 2026 paper: a single diffusion/flow-matching model that generates motion for very different skeleton types (bipedal, quadrupedal, avian, marine, insectoid, serpentine, and even rigid articulated objects) from a rigged 3D asset plus a text prompt, without retraining per skeleton.

  32. 35

    mlx-serve

    2Kddalcu/mlx-serve · Zig

    mlx-serve is a native local inference server for Apple Silicon Macs that runs MLX and GGUF language models and exposes OpenAI-, Anthropic-, and Ollama-compatible APIs, plus generates images, video, music, speech, and 3D models, all without Python or a cloud connection.

  33. 36

    AuK

    1.5KTencent-Hunyuan/AuK · Python

    An open-source 1.5B-parameter foundation model from Tencent Hunyuan for speech generation and editing: zero-shot and instruct TTS, speech editing, enhancement, and source separation — all driven through one natural-language instruction interface.

  34. 37

    marigold-v2

    919huawei-bayerlab/marigold-v2 · Python

    Marigold V2 is a family of models and a cost-effective fine-tuning protocol that repurposes a pretrained diffusion transformer into single-step dense predictors: depth, see-through depth, surface normals, albedo, and other dense modalities.

  35. 38

    SolarWM

    781Junchao-cs/SolarWM · Python

    SolarWM is a fully open foundation for building interactive video world models, covering data preparation, scalable multi-backbone training, and long-horizon inference.

  36. 39

    LoongForge

    695baidu-baige/LoongForge · Python

    An open-source training framework from Baidu's Baige team for LLMs, VLMs, diffusion and embodied models, built for faster training and lower cost on NVIDIA GPUs and Kunlun XPUs.

  37. 40

    DreamX-Creator

    313AMAP-ML/DreamX-Creator · Python

    DreamX-Creator is an open-source research framework for native joint audio-video generation: it produces video and a synchronized audio track together, refined up to 2K resolution.

  38. 41

    ComfyUI-MiniMax-H3-LongMedia

    297vizart-vj/ComfyUI-MiniMax-H3-LongMedia · Python

    A set of production-oriented custom nodes for ComfyUI that run MiniMax H3 for long-form video and audio generation: reference editing, MultiClip planning, camera direction, fixed segmentation, lip-sync and redubbing, latent hi-res refinement, and low-VRAM-safe execution.

  39. 42

    fix-anything

    246kvuong2711/fix-anything · Python

    A research tool from an ECCV 2026 paper: a video diffusion model fine-tuned to repair rendering artifacts from any 3D representation — 3DGS, NeRF, meshes, or sparse point clouds. The repo holds the inference code.

  40. 43

    Comfyui-MMH3-UltimateUpscale

    238bbaudio-2025/Comfyui-MMH3-UltimateUpscale · Python

    A ComfyUI custom node that upscales long, high-resolution MiniMax H3 AV video latents on VRAM-limited GPUs, using temporal chunking and spatial tiling inside a single node while keeping the audio track intact.

  41. 44

    zing-world-model

    173seedleap/zing-world-model · Python

    Zing-0.5 is an efficient causal world model that generates a real-time video world, letting you steer it live with text prompts and W/A/S/D/I/J/K/L keyboard actions.

  42. 45

    hyperflow

    147Video-Rebirth/hyperflow · Python

    An 8-step LoRA adapter for MiniMax-H3, a video+audio generation model, trained by data-free flow self-distillation. This repository holds the loader and example scripts that run it on the diffusers Modular Pipeline.

Often tagged together