Global

knowledge-distillation
12 projects tagged “knowledge-distillation” that gained the most stars yesterday
#699 · +45 · 1d ·GitHub

pth) - 支持跨不同 GPU 数量恢复(自动调整 step) - 支持 wandb 训练记录连续性(自动恢复同一个 run)

Size
38.6 MB
Stars
63.9K
Age
2y
Commits · 90 Days
#782 · +39 · 1d ·GitHub

Distilly is a local-first product for turning a person's source material, working habits, judgment, and voice into a versioned Person Profile for Agents. The profile can be recalled temporarily during a run or explicitly installed as a long-lived host Skill.

Creator
titanwings
Size
20.8 MB
Stars
25.8K
Updated
CommitOct 13
Age
6mo
Commits · 90 Days
#955 · +31 · 1d ·GitHub

The website provides visual Skill Pack browsing, a beginner-friendly usage guide, Skill detail pages, and a contribution submission entry.

Size
71.5 MB
Stars
11.4K
Age
6mo
Commits · 90 Days
#2277 · +9 · 1d ·GitHub

DeepSeek-R1-Distill models are fine-tuned based on open-source models, using samples generated by DeepSeek-R1. We slightly change their configs and tokenizers. Please use our setting to run these models.

Size
1.5 MB
Stars
91.9K
Age
1y
Commits · 90 Days
#2384 · +9 · 1d ·GitHub

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc.

Creator
NVIDIA
Size
165.2 MB
Stars
5.4K
Age
2y
Commits · 90 Days
#2738 · +7 · 1d ·GitHub

We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.

Creator
OpenBMB
Size
162.5 MB
Stars
11.6K
Age
2y
Commits · 90 Days
#3899 · +3 · 1d ·GitHub

本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

Size
24.9 MB
Stars
25.2K
Updated
CommitOct 14
Age
3y
Commits · 90 Days
#4367 · +2 · 1d ·GitHub

The largest collection of PyTorch image encoders / backbones.

Size
32.2 MB
Stars
37.2K
Age
7y
Commits · 90 Days
#5445 · +1 · 1d ·GitHub

《李宏毅深度学习教程》(李宏毅老师推荐👍,苹果书🍎),PDF下载地址:

Size
302 MB
Stars
16.8K
Age
7y
Commits · 90 Days
#5480 · +1 · 1d ·GitHub
archived

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

Creator
microsoft
Size
1.1 MB
Stars
16.1K
Updated
CommitJul 15
Age
5y
Commits · 90 Days
#8273 · +0 · 1d ·GitHub

py is the client-facing contract (commands, messages, tracks), and the streaming client speaks exactly that — through reactor-sdk, the Reactor Python SDK, which carries the session, the commands and messages, and the WebRTC media tracks.

Size
0.8 MB
Stars
240
Updated
CommitAug 30
Age
1mo
Commits · 90 Days
#8640 · +0 · 1d ·GitHub

IMPORTANT] > Seeking Research and Dev. Collaborations. We are actively looking for research > collaborators to explore downstream applications built on DMI such as interpretability, speculative decoding, > hallucination analysis, distillation, activation steering, and beyond.

Creator
ProjectDMX
Size
169.2 MB
Stars
65
Updated
CommitOct 14
Age
1y
Commits · 90 Days