Topics / #finetuning

Finetuning projects on GitHub

Fine-tuning language models with custom training recipes.

As of , the most-starred Finetuning projects on GitHub are LLMs-from-scratch (106.8K stars), DeepSeek-Coder (24.3K stars) and Qwen (21.9K stars). GitHub.Locker tracks 7 Finetuning repositories with 212.2K stars combined. The fastest-growing on October 18 was WanGP, with +95 stars in a day.

7Projects
212.2KStars in total
+172Stars in a day
Browse in the catalog →github.com/topics/finetuning ↗

Hot right now

Most stars gained in a day · Oct 18

+95

WanGP

deepbeepmeep/WanGP · ★ 10.7K

WanGP is a one-stop open source app for running top generative AI models for video, image, and audio/TTS generation, built specifically to work on modest consumer GPUs (the 'GPU Poor').

+63

LLMs-from-scratch

rasbt/LLMs-from-scratch · ★ 106.8K

This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

+7

Qwen

QwenLM/Qwen · ★ 21.9K

The official repo of Qwen (通义千问, Tongyi Qianwen) — Alibaba Cloud's family of chat and pretrained large language models, released in sizes from 1.8B up to 72B parameters on Hugging Face and ModelScope.

+5

DeepSeek-Coder

deepseek-ai/DeepSeek-Coder · ★ 24.3K

DeepSeek Coder is a family of open-source code language models trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese), built for code generation, completion, and infilling.

The all-time top

7 projects · by stars

  1. #1 · rasbt/LLMs-from-scratch

    LLMs-from-scratch

    This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

    106.8K
  2. #2 · deepseek-ai/DeepSeek-Coder

    DeepSeek-Coder

    DeepSeek Coder is a family of open-source code language models trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese), built for code generation, completion, and infilling.

    24.3K
  3. #3 · QwenLM/Qwen

    Qwen

    The official repo of Qwen (通义千问, Tongyi Qianwen) — Alibaba Cloud's family of chat and pretrained large language models, released in sizes from 1.8B up to 72B parameters on Hugging Face and ModelScope.

    21.9K
  1. 4

    alpaca-lora

    18.9Ktloen/alpaca-lora · Jupyter Notebook

    Alpaca-LoRA reproduces the Stanford Alpaca results by instruct-tuning LLaMA with low-rank adaptation (LoRA). It ships the training code, inference scripts, and the resulting LoRA weights, producing an Instruct model of similar quality to text-davinci-003.

  2. 5

    llama-cookbook

    18.6Kmeta-llama/llama-cookbook · Jupyter Notebook

    The Llama Cookbook — Meta's official collection of recipes for building with the Llama model family: inference, fine-tuning, RAG and end-to-end use cases, mostly written as Jupyter notebooks.

  3. 6

    qlora

    11Kartidoro/qlora · Jupyter Notebook

    QLoRA is a research method and code release for efficiently finetuning large quantized language models. It backpropagates gradients through a frozen 4-bit quantized model into small LoRA adapters, cutting memory use enough to finetune a 65B model on a single 48GB GPU while matching full 16-bit finetuning quality.

  4. 7

    WanGP

    10.7Kdeepbeepmeep/WanGP · Python

    WanGP is a one-stop open source app for running top generative AI models for video, image, and audio/TTS generation, built specifically to work on modest consumer GPUs (the 'GPU Poor').

Often tagged together