Rlhf projects on GitHub

Reinforcement learning from human feedback for aligning language model behavior.

As of October 19, 2026, the most-starred Rlhf projects on GitHub are LlamaFactory (75.5K stars), dive-into-llms (56.9K stars) and ColossalAI (41.4K stars). GitHub.Locker tracks 22 Rlhf repositories with 481.8K stars combined. The fastest-growing on October 17 was dive-into-llms, with +33 stars in a day.

22Projects

481.8KStars in total

+113Stars in a day

Browse in the catalog →github.com/topics/rlhf ↗

Hot right now

Most stars gained in a day · Oct 17

+33

dive-into-llms

Lordog/dive-into-llms · ★ 56.9K

It's a free Chinese-language tutorial series called 'Dive into LLMs' (《动手学大模型》) that teaches large language model concepts through hands-on coding exercises, built from Shanghai Jiao Tong University's NLP and AI-security course materials.

+25

LlamaFactory

hiyouga/LlamaFactory · ★ 75.5K

LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.

+10

hands-on-modern-rl

walkinglabs/hands-on-modern-rl · ★ 4.7K

Hands-On Modern RL is an open-source course and book that walks learners from basic reinforcement learning concepts through LLM alignment (RLHF, DPO, GRPO, RLVR) and into advanced agentic systems, combining theory with runnable code.

verl

verl-project/verl · ★ 23.9K

verl is a flexible, efficient and production-ready reinforcement learning training library for LLMs, initiated by ByteDance's Seed team and maintained by the community. It is the open-source version of the HybridFlow paper (EuroSys 2025).

The all-time top

22 projects · by stars

#1 · hiyouga/LlamaFactory
LlamaFactory
LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.
75.5K
#2 · Lordog/dive-into-llms
dive-into-llms
It's a free Chinese-language tutorial series called 'Dive into LLMs' (《动手学大模型》) that teaches large language model concepts through hands-on coding exercises, built from Shanghai Jiao Tong University's NLP and AI-security course materials.
56.9K
#3 · hpcaitech/ColossalAI
ColossalAI
Colossal-AI is an open-source system for training and running large AI models more cheaply, faster and with less hardware, by providing a toolbox of parallelism and memory-optimization techniques.
41.4K

4
LLM101n
37.5Kkarpathy/LLM101n
LLM101n is a planned course by Andrej Karpathy that walks through building a 'Storyteller' AI language model end-to-end, from basics all the way to a ChatGPT-like web app, implemented from scratch in Python, C and CUDA.
5
Open-Assistant
37.4KLAION-AI/Open-Assistant · Python
OpenAssistant was a community project to build a free, open chat-based assistant like ChatGPT, trained on crowdsourced instruction data and RLHF. The project has since wrapped up: the final 'oasst2' dataset is published on Hugging Face and the repo stands as a record of the effort.
6
open-r1
26.5Khuggingface/open-r1 · Python
Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.
7
llm-action
25.2Kliguodongiot/llm-action · HTML
It is a Chinese-language hub of in-depth tutorials on large language model engineering: training, fine-tuning, distributed training, inference, compression, evaluation, data engineering, LLMOps and AI infrastructure, organized as a big index linking the author's article series, many with companion code.
8
verl
23.9Kverl-project/verl · Python
verl is a flexible, efficient and production-ready reinforcement learning training library for LLMs, initiated by ByteDance's Seed team and maintained by the community. It is the open-source version of the HybridFlow paper (EuroSys 2025).
9
peft
21.8Khuggingface/peft · Python
Hugging Face's library of Parameter-Efficient Fine-Tuning methods: you adapt a large pretrained model by training only a small number of extra parameters instead of all of them, which slashes compute and storage costs.
10
trl
19.5Khuggingface/trl · Python
TRL (Transformers Reinforcement Learning) is a Hugging Face library for post-training foundation models — fine-tuning them with techniques like SFT, GRPO and DPO on top of the Transformers stack.
11
ms-swift
15.9Kmodelscope/ms-swift · Python
ms-swift is the ModelScope community's fine-tuning and deployment framework for LLMs and multimodal models, covering training, inference, evaluation, quantization and deployment in one pipeline.
12
StableLM
15.7KStability-AI/StableLM · Jupyter Notebook
StableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.
13
llm_interview_note
15.3Kwdndev/llm_interview_note · HTML
This is a curated Chinese-language knowledge base of large language model (LLM) concepts and interview questions, aimed at algorithm/application engineers preparing for LLM-related job interviews.
14
LLMSurvey
12.2KRUCAIBox/LLMSurvey · Python
It is the official GitHub page for the survey paper 'A Survey of Large Language Models' — a curated collection of papers and resources on how LLMs are built, adapted, and used.
15
train-llm-from-scratch
12.2KFareedKhan-dev/train-llm-from-scratch · Python
A from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.
16
ludwig
11.8Kludwig-ai/ludwig · Python
Ludwig is a declarative deep learning framework that lets you train, fine-tune, and deploy AI models — from LLM fine-tuning to tabular classification — using a YAML config file and zero boilerplate Python.
17
amazon-sagemaker-examples
11Kaws/amazon-sagemaker-examples · Jupyter Notebook
A collection of official Jupyter notebooks from AWS that demonstrate how to build, train, and deploy machine learning models using Amazon SageMaker.
18
nlp_course
10.7Kyandexdataschool/nlp_course · Jupyter Notebook
This is the Yandex School of Data Analysis (YSDA) Natural Language Processing course: a full set of lecture slides, seminar notebooks, and homework assignments organized by week, covering NLP from word embeddings through modern LLM topics.
19
OpenClaw-RL
5.7KGen-Verse/OpenClaw-RL · Python
OpenClaw-RL is a fully asynchronous reinforcement learning framework that turns everyday conversations with an agent into training signals, letting you train a personalized OpenClaw agent just by talking to it, or train general agents for terminal, GUI, SWE, and tool-call tasks.
20
hands-on-modern-rl
4.7Kwalkinglabs/hands-on-modern-rl · Python
Hands-On Modern RL is an open-source course and book that walks learners from basic reinforcement learning concepts through LLM alignment (RLHF, DPO, GRPO, RLVR) and into advanced agentic systems, combining theory with runnable code.
- rl
- dpo
- ppo
- sft
21
halo
825whitecircle/halo · Python
Halo is an open-source framework from White Circle for training large language and multimodal models: pre-training, SFT, preference optimization, and fully asynchronous multi-turn RL in one codebase, from a single GPU up to multi-node clusters.
22
EvoTrace
292jinzijian/EvoTrace · Python
EvoTrace mines the Claude Code and Codex coding-agent sessions already on your machine, finds the ones worth keeping, and compiles them into verified, reusable post-training assets: preference data, replayable coding tasks, RL environments, and execution-reward candidates.