Topics / #distillation

Distillation projects on GitHub

Knowledge distillation: training compact models to mimic larger teacher models

As of , the most-starred Distillation projects on GitHub are TurboDiffusion (3.9K stars), SparkDiffusion (570 stars) and SMD (264 stars). GitHub.Locker tracks 5 Distillation repositories with 5K stars combined. The fastest-growing on October 31 was SparkDiffusion, with +1 stars in a day.

5Projects
5KStars in total
+1Stars in a day
Browse in the catalog →github.com/topics/distillation ↗

Hot right now

Most stars gained in a day · Oct 31

+1

SparkDiffusion

AlibabaResearch/SparkDiffusion · ★ 570

SparkDiffusion is an acceleration framework for Diffusion Transformer (DiT) video-generation models. It combines sparse low-rank attention (RoLa), few-step distillation (CrossDistill), and custom GPU operators to deliver 200x+ faster inference than a dense multi-step baseline while preserving generation quality.

The all-time top

5 projects · by stars

  1. #1 · thu-ml/TurboDiffusion

    TurboDiffusion

    TurboDiffusion is a video generation acceleration framework that speeds up end-to-end video diffusion generation by 100-200x on a single RTX 5090 while keeping video quality, using SageAttention, Sparse-Linear Attention (SLA), and rCM timestep distillation.

    3.9K
  2. #2 · AlibabaResearch/SparkDiffusion

    SparkDiffusion

    SparkDiffusion is an acceleration framework for Diffusion Transformer (DiT) video-generation models. It combines sparse low-rank attention (RoLa), few-step distillation (CrossDistill), and custom GPU operators to deliver 200x+ faster inference than a dense multi-step baseline while preserving generation quality.

    570
  3. #3 · zjwfufu/SMD

    SMD

    SMD is a research method and codebase for distilling diffusion models into fast few-step generators, covering image, video, audio-video and 3D generation tasks.

    264
  1. 4

    swarm-agent

    170lyt2003-yt/swarm-agent · Python

    SwarmAgent is a conversational agent that turns natural-language requests like 'choreograph this song, make the second section gentler' into validated drone-swarm trajectories, built on the ReAct paradigm and sitting on top of a separately deployed SwarmGPT service.

  2. 5

    hyperflow

    158Video-Rebirth/hyperflow · Python

    An 8-step LoRA adapter for MiniMax-H3, a video+audio generation model, trained by data-free flow self-distillation. This repository holds the loader and example scripts that run it on the diffusers Modular Pipeline.

Often tagged together