Topics / #model-training
Model-training projects on GitHub
Training machine learning models on datasets.
As of , the most-starred Model-training projects on GitHub are yolov5 (58.2K stars), Retrieval-based-Voice-Conversion-WebUI (38.8K stars) and open-r1 (26.5K stars). GitHub.Locker tracks 28 Model-training repositories with 307.4K stars combined. The fastest-growing on October 16 was Retrieval-based-Voice-Conversion-WebUI, with +23 stars in a day.
Hot right now
Most stars gained in a day · Oct 16
Retrieval-based-Voice-Conversion-WebUI
RVC-Project/Retrieval-based-Voice-Conversion-WebUI · ★ 38.8KRVC WebUI is a web-based tool for training and running voice conversion (voice-changing) models, letting you clone a target voice's timbre using as little as about 10 minutes of audio.
+20train-llm-from-scratch
FareedKhan-dev/train-llm-from-scratch · ★ 12.2KA from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.
+20Intern-Decision
InternLM/Intern-Decision · ★ 811Intern-Decision turns a state, optional images, and multiple typed questions into decisions with probabilities, by fine-tuning the language backbone of Qwen3.5 while freezing its vision tower and projector.
+18higgsfield
higgsfield-ai/higgsfield · ★ 6.1KHiggsfield is an open-source, fault-tolerant GPU orchestration system and machine learning framework for training huge models, from billions to trillions of parameters, such as LLMs.
The all-time top
28 projects · by stars
- 58.2K
#1 · ultralytics/yolov5yolov5
YOLOv5 is a fast, accurate, and easy-to-use computer vision model from Ultralytics for object detection, instance segmentation, and image classification, built on PyTorch.
- 38.8K
#2 · RVC-Project/Retrieval-based-Voice-Conversion-WebUI
Retrieval-based-Voice-Conversion-WebUI
RVC WebUI is a web-based tool for training and running voice conversion (voice-changing) models, letting you clone a target voice's timbre using as little as about 10 minutes of audio.
- 26.5K
#3 · huggingface/open-r1open-r1
Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.
- 4

examples
24.1Kpytorch/examples · PythonA curated set of short, standalone PyTorch example projects covering computer vision, text, and reinforcement learning, each meant to be emulated in your own work.
- 5

Megatron-LM
18.2KNVIDIA/Megatron-LM · PythonNVIDIA's open-source toolkit for training large transformer (LLM) models at scale. It comes as Megatron-LM, a reference setup with ready training scripts, and Megatron Core, a composable library of GPU-optimized building blocks for training models across thousands of GPUs.
- 6

vision
18Kpytorch/vision · PythonTorchvision is PyTorch's computer vision package: popular datasets, ready-made model architectures, and common image transformations for vision work.
- 7

StableLM
15.7KStability-AI/StableLM · Jupyter NotebookStableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.
- 8

DiffSynth-Studio
13.3Kmodelscope/DiffSynth-Studio · PythonDiffSynth-Studio is an open-source Diffusion model engine built and maintained by the ModelScope Community, covering image, video, and audio generation plus image quality metrics, with support for both inference and training.
- 9

ai-toolkit
12.3Kostris/ai-toolkit · PythonAI Toolkit is an all-in-one training suite for finetuning diffusion models, covering image, video, and audio generation models, with support for the latest models like FLUX, Qwen-Image, Wan 2.1/2.2, and Ace-Step on consumer GPUs.
- 10

train-llm-from-scratch
12.2KFareedKhan-dev/train-llm-from-scratch · PythonA from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.
- 11

allennlp
11.9Kallenai/allennlp · PythonAllenNLP is an open-source NLP research library built on PyTorch for developing state-of-the-art deep learning models across a wide range of linguistic tasks.
- 12

dolly
10.8Kdatabrickslabs/dolly · PythonDolly is Databricks' instruction-following large language model, trained on the Databricks Machine Learning Platform and licensed for commercial use; the flagship dolly-v2-12b derives from EleutherAI's Pythia-12b.
- 13

yolov3
10.6Kultralytics/yolov3 · PythonUltralytics' PyTorch implementation of the YOLOv3 real-time object detector, packaging three model variants - YOLOv3, YOLOv3-SPP and YOLOv3-tiny - with training, validation, inference and multi-format export tooling.
- 14
reef
7.6KHuman-Agent-Society/reef · PythonReef is open-source infrastructure for continually self-improving agents. It wires together agent inference, feedback collection, learning, and versioned delivery so an agent keeps getting better from how you interact with it.
- 15

ANE
7.3Kmaderix/ANE · Objective-CANE is a research project that trains neural networks directly on Apple's Neural Engine using reverse-engineered private APIs, instead of CoreML's inference-only path.
- 16

DeepSpec
7.2Kdeepseek-ai/DeepSpec · PythonDeepSpec is DeepSeek's full-stack Python codebase for training and evaluating draft models for speculative decoding — the technique where a small draft model accelerates a larger target LLM.
- 17

higgsfield
6.1Khiggsfield-ai/higgsfield · Jupyter NotebookHiggsfield is an open-source, fault-tolerant GPU orchestration system and machine learning framework for training huge models, from billions to trillions of parameters, such as LLMs.
- 18

Attention-Residuals
3.5KMoonshotAI/Attention-ResidualsAttnRes (Attention Residuals) is a drop-in replacement for standard residual connections in Transformers, letting each layer use learned, input-dependent attention over all previous layer outputs instead of simple additive accumulation.
- 19

mini-AGI
1.2Kvolotat/mini-AGI · Pythonmini-AGI is a continual learning, byte-level language model that assembles its own architecture, trains from scratch on a single 8GB VRAM GPU, and keeps learning from everything it reads, without a separate fine-tuning phase.
- 20
Valen
843Liuziyu77/Valen · Jupyter NotebookValen (万澜) is a multimodal decision model that adds visual perception to System One-style decision-making: it scores candidate actions against text, images and video using a task instruction, instead of generating free-form answers.
- 21

Intern-Decision
811InternLM/Intern-Decision · PythonIntern-Decision turns a state, optional images, and multiple typed questions into decisions with probabilities, by fine-tuning the language backbone of Qwen3.5 while freezing its vision tower and projector.
- 22

SolarWM
777Junchao-cs/SolarWM · PythonSolarWM is a fully open foundation for building interactive video world models, covering data preparation, scalable multi-backbone training, and long-horizon inference.
- 23

Meshy
387OpenBMB/Meshy · PythonMeshy is an open-source framework for running reinforcement learning (RL) training jobs where every role (inference, training, rollout) runs as an independent service, communicating through a shared TransferQueue data plane. It is built on SGLang and torchtitan.
- 24

nnUNet_att_position_correction
354qpuchen/nnUNet_att_position_correction · PythonThis is the official PyTorch code for the MICCAI 2023 STS Challenge (3D tooth segmentation from CBCT scans) by team sdkxd, which extends nn-UNet with axial attention and a positional correction module to clean up abnormal segmentation points.
- 25

LittleBit
283SamsungLabs/LittleBit · PythonLittleBit is the official research code for compressing large language models to sub-1-bit precision (down to 0.1 bits per weight) by factorizing each weight matrix into low-rank latent factors and binarizing them, with magnitude restored through learned scales. It also includes LittleBit-2, a follow-up that improves initialization via latent geometry alignment.
- 26

video-prediction-policy-2
249roboterax/video-prediction-policy-2 · PythonVideo Prediction Policy 2 (VPP2) is a world-action model (WAM) for robot manipulation that predicts future video frames and converts them into robot actions, with strong zero-shot generalization across tasks.
- 27

pointdit
233google-research/pointdit · PythonPointDiT is a research codebase for a minimalist pixel-space Diffusion Transformer that estimates 3D geometry (point maps) from a single monocular image.
- 28

UniVR
178FlagOpen/UniVR · PythonUniVR is an end-to-end SFT and Reinforcement Learning (GRPO) training framework built specifically for Emu3.5 series unified generative models, letting you train visual reasoning tasks by swapping in your own data loader and reward function.
Related topics
Often tagged together
- deep-learning737
- python2,383
- machine-learning916
- gpu789
- pytorch419
- research764
- huggingface362
- open-source5,666
- cuda396
- fine-tuning185
- llm1,483
- ai1,955
- benchmark431
- apache-2.01,434
- large-language-models213
- academic-research209
- linux4,184
- training91
- transformer212
- computer-vision384
- inference327
- nvidia328
- transformers97
- neural-network166