Topics / #instruction-tuning

Instruction-tuning projects on GitHub

Fine-tuning methods that teach language models to follow user instructions.

As of October 17, 2026, the most-starred Instruction-tuning projects on GitHub are LLMs-from-scratch (106.7K stars), LlamaFactory (75.5K stars) and stanford_alpaca (30.2K stars). GitHub.Locker tracks 12 Instruction-tuning repositories with 370.5K stars combined. The fastest-growing on October 16 was LLMs-from-scratch, with +65 stars in a day.

12Projects

370.5KStars in total

+120Stars in a day

Browse in the catalog →github.com/topics/instruction-tuning ↗

Hot right now

Most stars gained in a day · Oct 16

+65

LLMs-from-scratch

rasbt/LLMs-from-scratch · ★ 106.7K

This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

+24

LlamaFactory

hiyouga/LlamaFactory · ★ 75.5K

LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.

+20

train-llm-from-scratch

FareedKhan-dev/train-llm-from-scratch · ★ 12.2K

A from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.

FinGPT

AI4Finance-Foundation/FinGPT · ★ 21.4K

FinGPT is AI4Finance Foundation's open-source project for financial large language models: trained models are released on HuggingFace, with code for RAG, fine-tuning pipelines and benchmarks built around them.

The all-time top

12 projects · by stars

#1 · rasbt/LLMs-from-scratch
LLMs-from-scratch
This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.
106.7K
#2 · hiyouga/LlamaFactory
LlamaFactory
LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.
75.5K
#3 · tatsu-lab/stanford_alpaca
stanford_alpaca
Stanford's official Alpaca repo: code and docs for training an instruction-following LLaMA model and generating its 52K instruction dataset. In preliminary human evaluation the 7B model behaved similarly to text-davinci-003.
30.2K

4
llama3
29.2Kmeta-llama/llama3 · Python
Meta's official GitHub home for Llama 3: model weights plus minimal code for running inference on pre-trained and instruction-tuned models in 8B and 70B sizes. The repo is now deprecated.
5
LLaVA
25.1Khaotian-liu/LLaVA · Python
LLaVA is an open-source large multimodal chatbot: a vision-language model you can show images to and talk with, built by visual instruction tuning toward GPT-4V-level capabilities (NeurIPS 2023 Oral).
6
FinGPT
21.4KAI4Finance-Foundation/FinGPT · Jupyter Notebook
FinGPT is AI4Finance Foundation's open-source project for financial large language models: trained models are released on HuggingFace, with code for RAG, fine-tuning pipelines and benchmarks built around them.
7
Chinese-LLaMA-Alpaca
18.9Kymcui/Chinese-LLaMA-Alpaca · Python
Open-source Chinese LLaMA and Alpaca large language models. The base LLaMA was extended with a Chinese vocabulary and further pre-trained on Chinese data, and Alpaca versions were instruction-tuned on Chinese instructions; training and deployment scripts are open too.
8
Awesome-Multimodal-Large-Language-Models
18.1KBradyFU/Awesome-Multimodal-Large-Language-Models
A curated, continuously updated list of papers, models, datasets, and benchmarks tracking the latest advances in Multimodal Large Language Models (MLLMs) — models like GPT-4o, Gemini, and VITA that understand images, video, and audio alongside text.
9
LLMSurvey
12.2KRUCAIBox/LLMSurvey · Python
It is the official GitHub page for the survey paper 'A Survey of Large Language Models' — a curated collection of papers and resources on how LLMs are built, adapted, and used.
10
train-llm-from-scratch
12.2KFareedKhan-dev/train-llm-from-scratch · Python
A from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.
11
dolly
10.8Kdatabrickslabs/dolly · Python
Dolly is Databricks' instruction-following large language model, trained on the Databricks Machine Learning Platform and licensed for commercial use; the flagship dolly-v2-12b derives from EleutherAI's Pythia-12b.
12
LLMsPracticalGuide
10.2KMooler0410/LLMsPracticalGuide
A curated, actively updated list of practical guide resources for large language models (LLMs), covering models, data, NLP tasks, and usage restrictions. It is based on a survey paper 'Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond'.