Fine-tuning projects on GitHub

1. 1
   #1 · huggingface/transformers

   transformers

   Transformers is Hugging Face's model-definition framework for state-of-the-art machine learning models across text, vision, audio, video, and multimodal tasks, usable for both inference and training.

   167.8K
2. 2
   #2 · microsoft/generative-ai-for-beginners

   generative-ai-for-beginners

   A 21-lesson course by Microsoft Cloud Advocates that teaches the fundamentals of building Generative AI applications, covering concepts like prompt engineering, chat apps, RAG, fine-tuning, and AI agents.

   121.5K
3. 3
   #3 · deepseek-ai/DeepSeek-R1

   DeepSeek-R1

   DeepSeek-R1 is an open-source family of reasoning-focused large language models from DeepSeek, trained with large-scale reinforcement learning to handle math, code, and general reasoning at a level comparable to OpenAI's o1.

   91.9K

4. 4

   llm-course

   83.7Kmlabonne/llm-course

   A free, open-source course for getting into Large Language Models (LLMs), combining theory roadmaps with hands-on Colab notebooks covering everything from math fundamentals to fine-tuning and deployment.

   • roadmap
   • llms
   • course
   • jupyter notebook
5. 5

   unsloth

   78.2Kunslothai/unsloth · Python

   Unsloth is a local-first app for running and training LLMs, diffusion, TTS and embedding models on your own machine, including models like Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4 and FLUX.

   • dpo
   • qlora
   • intel
   • kaggle
6. 6

   LlamaFactory

   75.5Khiyouga/LlamaFactory · Python

   LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.

   • llama3
   • peft
   • qlora
   • instruction-tuning
7. 7

   nanoGPT

   63.9Kkarpathy/nanoGPT · Python

   nanoGPT is the simplest, fastest repository for training and finetuning medium-sized GPT language models, written as a minimal rewrite of minGPT.

   • karpathy
   • gpt-2
   • text-generation
   • gpt
8. 8

   minimind

   63.9Kjingyaogong/minimind · Python

   MiniMind is an open-source project that lets you train a tiny large language model (around 64M parameters) completely from scratch, in about 2 hours on a single RTX 3090 for roughly the cost of 3 RMB in GPU rental.

   • large-language-model
   • ppo
   • knowledge-distillation
   • grpo
9. 9

   nanochat

   58.7Kkarpathy/nanochat · Python

   A minimal, hackable harness for training your own LLM end to end (tokenization, pretraining, finetuning, evaluation, inference) on a single GPU node, ending in a chatbot you talk to over a CLI.

   • wandb
   • gpt-2
   • pretraining
   • llm-training
10. 10

    dive-into-llms

    56.8KLordog/dive-into-llms · Jupyter Notebook

    It's a free Chinese-language tutorial series called 'Dive into LLMs' (《动手学大模型》) that teaches large language model concepts through hands-on coding exercises, built from Shanghai Jiao Tong University's NLP and AI-security course materials.

    • rlhf
    • jailbreak
    • ai-security
    • reasoning
11. 11

    ai-agent-book

    54.6Kbojieli/ai-agent-book · Python

    An open-source book by Li Bojie taking AI agents from design principles to engineering practice, built on the formula Agent = LLM + context + tools; text, figures and labs all live in this repo.

    • experiments
    • epub
    • computer-use
    • llm-agents
12. 12

    llama_index

    52.5Krun-llama/llama_index · Python

    LlamaIndex is an open-source Python framework for building agentic applications that augment LLMs with your own private data, letting you ingest, index, and query documents with LLM-powered pipelines.

    • llamaindex
    • application
    • retrieval
    • data
13. 13

    textgen

    47.7Koobabooga/textgen · Python

    TextGen is an open-source desktop app for running local LLMs with text, vision, tool-calling, and an OpenAI/Anthropic-compatible API, built to be 100% private with no telemetry.

    • vision
    • rocm
    • llama-cpp
    • tool-calling
14. 14

    BettaFish

    42.4K666ghj/BettaFish · Python

    BettaFish (Chinese name 'Weiyu'/微舆) is a from-scratch multi-agent public opinion analysis system that monitors social media and large volumes of public comments, then produces reports to help break information bubbles and support decision-making.

    • gpt-2
    • weibo
    • bert
    • sentiment-analysis
15. 15

    ColossalAI

    41.4Khpcaitech/ColossalAI · Python

    Colossal-AI is an open-source system for training and running large AI models more cheaply, faster and with less hardware, by providing a toolbox of parallelism and memory-optimization techniques.

    • hpc
    • distributed-computing
    • rlhf
    • distributed-training
16. 16

    ChatGLM-6B

    40.9Kzai-org/ChatGLM-6B · Python

    ChatGLM-6B is an open bilingual (Chinese-English) dialogue language model with 6.2 billion parameters, based on the General Language Model (GLM) architecture.

    • chatglm
    • open-weights
    • glm
    • bilingual
17. 17

    bert

    40Kgoogle-research/bert · Python

    Google's official TensorFlow implementation of BERT together with pre-trained checkpoints — a method for pre-training language representations that set state-of-the-art results on a wide range of NLP tasks, from SQuAD question answering to natural language inference.

    • named-entity-recognition
    • question-answering
    • language-model
    • neural-networks
18. 18

    FastChat

    39.5Klm-sys/FastChat · Python

    FastChat is an open platform for training, serving, and evaluating large language model based chatbots. It is the release repo for Vicuna and powers Chatbot Arena (lmarena.ai), which has served over 10 million chat requests for 70+ LLMs.

    • gradio
    • vllm
    • quantization
    • openai-compatible
19. 19

    VoxCPM

    39.4KOpenBMB/VoxCPM · Python

    VoxCPM is a tokenizer-free Text-to-Speech system that directly generates continuous speech representations through an end-to-end diffusion autoregressive architecture, skipping discrete tokenization for more natural, expressive speech. VoxCPM2 is the latest 2B-parameter release trained on 2M+ hours of multilingual audio.

    • tts-model
    • deeplearning
    • speech
    • llama-cpp
20. 20

    airllm

    39.1Klyogavin/airllm · Jupyter Notebook

    An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

    • consumer-gpu
    • chinese-nlp
    • qlora
    • mlx
21. 21

    dspy

    38.7Kstanfordnlp/dspy · Python

    DSPy is a Python framework for programming — rather than prompting — language models: you build modular AI systems in code, and its algorithms automatically optimize the prompts and weights.

    • llm-framework
    • self-improvement
    • optimization
    • nlp
22. 22

    ai-engineering-hub

    38.3Kpatchy631/ai-engineering-hub · Jupyter Notebook

    A curated collection of 93+ tutorials and real-world project implementations covering LLMs, RAG systems, and AI agents, organized by difficulty level.

    • ai-engineering
    • retrieval-augmented-generation
    • llms
    • jupyter notebook
23. 23

    LLM101n

    37.5Kkarpathy/LLM101n

    LLM101n is a planned course by Andrej Karpathy that walks through building a 'Storyteller' AI language model end-to-end, from basics all the way to a ChatGPT-like web app, implemented from scratch in Python, C and CUDA.

    • attention
    • tokenization
    • rlhf
    • jax
24. 24

    Open-Assistant

    37.4KLAION-AI/Open-Assistant · Python

    OpenAssistant was a community project to build a free, open chat-based assistant like ChatGPT, trained on crowdsourced instruction data and RLHF. The project has since wrapped up: the final 'oasst2' dataset is published on Hugging Face and the repo stands as a record of the effort.

    • discord-bot
    • rlhf
    • assistant
    • language-model
25. 25

    pytorch-image-models

    37.2Khuggingface/pytorch-image-models · Python

    PyTorch Image Models (timm) — the largest collection of PyTorch image encoders and backbones, shipped with pretrained weights plus train, eval, inference and export scripts.

    • imagenet
    • optimizer
    • self-supervised-learning
    • knowledge-distillation
26. 26

    timesfm

    34.6Kgoogle-research/timesfm · Python

    TimesFM is a pretrained time-series foundation model from Google Research used for time-series forecasting, similar in spirit to a language model but for numerical sequences.

    • forecasting
    • deep-neural-networks
    • time-series
    • foundation-models
27. 27

    happy-llm

    34.4Kdatawhalechina/happy-llm · Jupyter Notebook

    Happy-LLM is Datawhale's free open-source LLM course: a systematic tutorial that goes from NLP basics and the Transformer architecture to building and training your first large language model, then applying it with RAG and agents.

    • peft
    • qlora
    • sft
    • grpo
28. 28

    agents-course

    33.7Khuggingface/agents-course · MDX

    The official Hugging Face Agents Course: a free, hands-on curriculum that teaches how to build AI agents, progressing from the basics to agent frameworks and a certified final project.

    • llamaindex
    • certification
    • mdx
    • langchain
29. 29

    laya

    33.2KNandhaKishorM/laya · Python

    Laya is a non-autoregressive decision engine: instead of generating text, it answers typed questions — multiple choice, a numeric score, or yes/no — about any text in a single forward pass, across 100+ languages. A built-in router detects the language and picks the right checkpoint per request.

    • text-classification
    • calibration
    • systemd
    • nixos
30. 30

    self-llm

    32.5Kdatawhalechina/self-llm · Jupyter Notebook

    Self-llm is a Chinese-language tutorial collection that teaches beginners how to configure environments, deploy, and fine-tune (full-parameter or LoRA) 50+ open-source large language models and multimodal models on Linux.

    • deepseek-r1
    • lmstudio
    • chatglm
    • llama3
31. 31

    pytorch-lightning

    31.4KLightning-AI/pytorch-lightning · Python

    PyTorch Lightning is a deep learning framework for pretraining and finetuning AI models of any size, scaling from a single CPU to thousands of GPUs or TPUs without changing your model code.

    • generative-adversarial-network
    • distributed-training
    • mlops
    • onnx
32. 32

    llm.c

    31.2Kkarpathy/llm.c · Cuda

    llm.c is Karpathy's project for training large language models in raw C and CUDA, with no dependency on 245MB of PyTorch or 107MB of cPython. It currently focuses on pretraining GPT-2 and GPT-3-scale models, with train_gpt2.cu as the main CUDA training path.

    • hpc
    • pretraining
    • training
    • gpt
33. 33

    stanford_alpaca

    30.2Ktatsu-lab/stanford_alpaca · Python

    Stanford's official Alpaca repo: code and docs for training an instruction-following LLaMA model and generating its 52K instruction dataset. In preliminary human evaluation the 7B model behaved similarly to text-davinci-003.

    • instruction-tuning
    • llm-training
    • language-model
    • llama
34. 34

    Hands-On-Large-Language-Models

    29.7KHandsOnLLM/Hands-On-Large-Language-Models · Jupyter Notebook

    The official code repo for the O'Reilly book 'Hands-On Large Language Models', known as the Illustrated LLM Book. It contains a Jupyter notebook for each of the book's 12 chapters.

    • text-classification
    • classification
    • llms
    • semantic-search
35. 35

    Qwen3

    27.7KQwenLM/Qwen3 · Python

    Qwen3 is a series of open-weight large language models built by the Qwen team at Alibaba Cloud, released as both dense and Mixture-of-Experts (MoE) models from 0.6B up to 235B-A22B parameters, with switchable 'thinking' and 'non-thinking' reasoning modes.

    • alibaba
    • qwen3
    • llamacpp
    • foundation-models
36. 36

    Unlimited-OCR

    27.7Kbaidu/Unlimited-OCR · Python

    It's an open-source OCR model from Baidu built for one-shot parsing of long documents — the team positions it as pushing Deepseek-OCR one step further, with an arXiv paper backing the approach.

    • sglang
    • transformers
    • vllm
    • ocr
37. 37

    MiniCPM-V

    26.8KOpenBMB/MiniCPM-V · Python

    A family of pocket-sized multimodal AI models from OpenBMB (MiniCPM-V and MiniCPM-o) built to run on local devices, even phones — understanding images, video and text, and in the o-series also speech.

    • harmonyos
    • video-understanding
    • llama-cpp
    • on-device
38. 38

    open-r1

    26.5Khuggingface/open-r1 · Python

    Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.

    • sft
    • rlhf
    • model-training
    • distributed-training
39. 39

    llm-action

    25.2Kliguodongiot/llm-action · HTML

    It is a Chinese-language hub of in-depth tutorials on large language model engineering: training, fine-tuning, distributed training, inference, compression, evaluation, data engineering, LLMOps and AI infrastructure, organized as a big index linking the author's article series, many with companion code.

    • peft
    • ai-infrastructure
    • knowledge-distillation
    • llm-training
40. 40

    LLaVA

    25.1Khaotian-liu/LLaVA · Python

    LLaVA is an open-source large multimodal chatbot: a vision-language model you can show images to and talk with, built by visual instruction tuning toward GPT-4V-level capabilities (NeurIPS 2023 Oral).

    • llama2
    • instruction-tuning
    • gpt-4
    • foundation-models
41. 41

    llm-cookbook

    24.8Kdatawhalechina/llm-cookbook · Jupyter Notebook

    A developer-oriented LLM starter handbook: a Chinese adaptation of Andrew Ng's LLM course series, translated and re-run for Chinese developers, covering prompt engineering through RAG development and model fine-tuning.

    • chatgpt-api
    • cookbook
    • wandb
    • chromadb
42. 42

    CosyVoice

    24KQwenAudio/CosyVoice · Python

    CosyVoice is Alibaba's open-source, LLM-based text-to-speech system. It generates natural speech in 9 languages plus 18+ Chinese dialects, supports zero-shot voice cloning, and ships inference, training and deployment code.

    • tts-model
    • zero-shot-tts
    • gpt-4o
    • voice-conversion
43. 43

    verl

    23.9Kverl-project/verl · Python

    verl is a flexible, efficient and production-ready reinforcement learning training library for LLMs, initiated by ByteDance's Seed team and maintained by the community. It is the open-source version of the HybridFlow paper (EuroSys 2025).

    • grpo
    • rlhf
    • vlm
    • distributed-training
44. 44

    learnopencv

    23.2Kspmallick/learnopencv · Jupyter Notebook

    This is the companion code repository for the LearnOpenCV.com blog, containing C++ and Python examples that accompany articles on computer vision, deep learning, and AI research.

    • opencv
    • deeplearning
    • deep-neural-networks
    • stable-diffusion
45. 45

    Awesome-Chinese-LLM

    22.8KAiHubCN/Awesome-Chinese-LLM

    A curated collection of open-source LLM resources for Chinese, focused on smaller models that can be privately deployed and trained cheaply. It lists 100+ resources: models, applications, datasets, and tutorials.

    • chatglm
    • minimax
    • glm
    • awesome-lists
46. 46

    awesome-ai-engineering

    22.4Kdipakkr/awesome-ai-engineering

    A large curated list of AI engineering resources covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems, plus broader learning resources for students (programming languages, hackathons, cybersecurity, blockchain, and more).

    • ai-engineering
    • llmops
    • awesome-lists
    • ai-tools
47. 47

    peft

    21.8Khuggingface/peft · Python

    Hugging Face's library of Parameter-Efficient Fine-Tuning methods: you adapt a large pretrained model by training only a small number of extra parameters instead of all of them, which slashes compute and storage costs.

    • peft
    • llm-training
    • rlhf
    • diffusion
48. 48

    pytorch-handbook

    21.7Kzergtant/pytorch-handbook · Jupyter Notebook

    An open-source Chinese-language book that teaches PyTorch for deep learning, written as a set of Jupyter notebooks whose code has all been tested to actually run.

    • kaggle
    • deep-learning-tutorial
    • image-classification
    • natural-language-processing
49. 49

    FinGPT

    21.4KAI4Finance-Foundation/FinGPT · Jupyter Notebook

    FinGPT is AI4Finance Foundation's open-source project for financial large language models: trained models are released on HuggingFace, with code for RAG, fine-tuning pipelines and benchmarks built around them.

    • financial-analysis
    • technical-analysis
    • instruction-tuning
    • sentiment-analysis
50. 50

    gpt-oss

    20.5Kopenai/gpt-oss · Python

    The gpt-oss series: two open-weight language models from OpenAI — gpt-oss-120b and gpt-oss-20b — built for powerful reasoning, agentic tasks, and versatile developer use cases. The repo itself adds reference implementations, tools, and example clients around the models.

    • chain-of-thought
    • lmstudio
    • gpt-oss
    • function-calling
51. 51

    sam2

    20Kfacebookresearch/sam2 · Jupyter Notebook

    SAM 2 (Segment Anything Model 2) is Meta's foundation model for promptable segmentation of objects in both images and videos, extending the original Segment Anything Model with a streaming memory architecture for real-time video tracking.

    • meta
    • segmentation
    • foundation-models
    • pretrained-models
52. 52

    ktransformers

    19.6Kkvcache-ai/ktransformers · Python

    KTransformers is a research framework for efficient inference and fine-tuning of large language models through CPU-GPU heterogeneous computing, letting huge MoE models run on hardware that doesn't have enough VRAM to hold them entirely on GPU.

    • cpu-inference
    • intel
    • sglang
    • amd-gpu
53. 53

    ml-engineering

    19.5Kstas00/ml-engineering · Python

    An open book on machine learning engineering: methodologies, tools and step-by-step instructions for training, fine-tuning and running inference on large language models and multi-modal (VLM) models, written by the engineer who led the BLOOM-176B training.

    • hpc
    • courses
    • llm-training
    • vlm
54. 54

    trl

    19.5Khuggingface/trl · Python

    TRL (Transformers Reinforcement Learning) is a Hugging Face library for post-training foundation models — fine-tuning them with techniques like SFT, GRPO and DPO on top of the Transformers stack.

    • dpo
    • grpo
    • rlhf
    • lora
55. 55

    sentence-transformers

    19.2Khuggingface/sentence-transformers · Python

    Sentence Transformers is a framework for computing embeddings and using or training state-of-the-art embedding and reranker models, covering dense sentence embeddings, cross-encoder rerankers, sparse encoders, and multi-vector (ColBERT-style) encoders.

    • retrieval-augmented-generation
    • training
    • natural-language-processing
    • transformers
56. 56

    alpaca-lora

    18.9Ktloen/alpaca-lora · Jupyter Notebook

    Alpaca-LoRA reproduces the Stanford Alpaca results by instruct-tuning LLaMA with low-rank adaptation (LoRA). It ships the training code, inference scripts, and the resulting LoRA weights, producing an Instruct model of similar quality to text-davinci-003.

    • finetuning
    • llama
    • gradio
    • lora
57. 57

    agent-lightning

    18.7Kmicrosoft/agent-lightning · Python

    Agent Lightning is an open-source reinforcement-learning training framework from Microsoft that lets you train any existing AI agent with RL, with almost zero changes to the agent's own code.

    • llm-training
    • mlops
    • llm-agents
    • vllm
58. 58

    llama-cookbook

    18.6Kmeta-llama/llama-cookbook · Jupyter Notebook

    The Llama Cookbook — Meta's official collection of recipes for building with the Llama model family: inference, fine-tuning, RAG and end-to-end use cases, mostly written as Jupyter notebooks.

    • finetuning
    • llama2
    • long-context
    • vision
59. 59

    Foundations-of-LLMs

    18.3KZJU-LLMs/Foundations-of-LLMs

    An open-source textbook on the foundations of large language models, written by a team at Zhejiang University and freely available as a PDF.

    • in-context-learning
    • chain-of-thought
    • ebook
    • lora
60. 60

    WeClone

    18.3Kxming521/WeClone · Python

    WeClone is an open-source toolkit that turns your chat history into an AI twin: it fine-tunes an LLM on your own messages so a chatbot can reply in your personal style.

    • ai-companion
    • lora
    • slack
    • discord
61. 61

    aie-book

    17.9Kchiphuyen/aie-book · Jupyter Notebook

    The companion repo for Chip Huyen's book 'AI Engineering' (2025) and a collection of resources for AI engineers: chapter summaries, study notes, prompt examples, case studies. It's a work in progress and keeps growing.

    • hallucination-detection
    • study-guide
    • evaluation
    • jupyter notebook
62. 62

    stable-diffusion-webui-colab

    15.9Kcamenduru/stable-diffusion-webui-colab · Jupyter Notebook

    A set of ready-made Google Colab notebooks that install and run the Stable Diffusion WebUI in the cloud — one notebook per popular model, from SD 1.5 to waifu-diffusion and style fine-tunes.

    • colab-notebook
    • img2img
    • ai-art
    • colab
63. 63

    ms-swift

    15.9Kmodelscope/ms-swift · Python

    ms-swift is the ModelScope community's fine-tuning and deployment framework for LLMs and multimodal models, covering training, inference, evaluation, quantization and deployment in one pipeline.

    • peft
    • embedding
    • sft
    • grpo
64. 64

    gpt-3

    15.7Kopenai/gpt-3

    The official companion repo for the GPT-3 paper 'Language Models are Few-Shot Learners'. GPT-3 is an autoregressive language model with 175 billion parameters — 10x more than any previous non-sparse model — tested on few-shot learning across many NLP tasks.

    • gpt-3
    • pretraining
    • text-generation
    • arxiv
65. 65

    Second-Me

    15.7Kmindverse/Second-Me · Python

    Second Me is an open-source project that lets you train a personal, locally-hosted AI model that preserves your identity, memory, and context, then connects it to a decentralized network so it can represent you across apps.

    • personal-ai
    • llamacpp
    • mlx
    • decentralized
66. 66

    StableLM

    15.7KStability-AI/StableLM · Jupyter Notebook

    StableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.

    • rlhf
    • model-training
    • language-model
    • llama
67. 67

    ChatGLM2-6B

    15.5Kzai-org/ChatGLM2-6B · Python

    ChatGLM2-6B is an open bilingual (Chinese-English) conversational language model with 6 billion parameters, the second generation of ChatGLM-6B from Zhipu AI (Z.ai).

    • chatglm
    • glm
    • bilingual
    • gradio
68. 68

    ChuanhuChatGPT

    15.3KGaiZhenbiao/ChuanhuChatGPT · Python

    ChuanhuChatGPT is a web-based GUI for ChatGPT and many other LLMs, adding extras like agents, file-based Q&A, local model deployment, web search, and GPT fine-tuning on top of a Gradio interface.

    • chatgpt-api
    • midjourney
    • chatglm
    • gemma
69. 69

    llm_interview_note

    15.3Kwdndev/llm_interview_note · HTML

    This is a curated Chinese-language knowledge base of large language model (LLM) concepts and interview questions, aimed at algorithm/application engineers preparing for LLM-related job interviews.

    • interview-prep
    • rlhf
    • function-calling
    • coding-interview
70. 70

    easy-dataset

    15KConardLi/easy-dataset · JavaScript

    Easy Dataset is an app that turns domain documents (PDF, Markdown, DOCX, TXT, EPUB) into structured datasets for LLM fine-tuning, RAG, and model evaluation. It extracts questions from your text, generates answers with an LLM, and exports ready-to-use training data.

    • document-parsing
    • agplv3
    • dataset
    • evaluation
71. 71

    RD-Agent

    15Kmicrosoft/RD-Agent · Python

    R&D-Agent is a Microsoft multi-agent framework that automates data-driven R&D: one agent proposes new research ideas and another implements them, applied to quant trading, data mining, Kaggle competitions, paper reproduction, and LLM fine-tuning.

    • data-mining
    • development
    • quant
    • quantitative-finance
72. 72

    Llama-Chinese

    14.8KLlamaChinese/Llama-Chinese · Python

    Llama-Chinese is a Chinese-language community project built around Meta's Llama models (Llama2, Llama3, Llama4). It provides Chinese pretraining and fine-tuning, a custom Atom model series optimized for Chinese, and resources for training, deploying and using Llama in Chinese for free commercial use.

    • rl
    • chinese-nlp
    • pretraining
    • llama-cpp
73. 73

    openpi

    14.3KPhysical-Intelligence/openpi · Python

    openpi is a collection of open-source vision-language-action (VLA) models for robotics from the Physical Intelligence team, including pi0, pi0-FAST, and pi0.5, with pretrained checkpoints and code for fine-tuning and running them.

    • vision-language-action
    • jax
    • world-models
    • deep-neural-networks
74. 74

    open_clip

    14.2Kmlfoundations/open_clip · Python

    OpenCLIP is an open source implementation of OpenAI's CLIP model for training and using contrastive image-text (and now audio-text) models for tasks like zero-shot classification.

    • language-model
    • image
    • pretrained-models
    • multimodal
75. 75

    LoRA

    13.9Kmicrosoft/LoRA · Python

    LoRA (loralib) is Microsoft's reference implementation of the paper 'LoRA: Low-Rank Adaptation of Large Language Models'. It lets you fine-tune large models like GPT-2, RoBERTa and DeBERTa by training small low-rank matrices instead of all the original weights.

    • gpt-2
    • gpt-3
    • language-model
    • paper
76. 76

    litgpt

    13.7KLightning-AI/litgpt · Python

    LitGPT is a collection of 20+ high-performance large language models (Llama, Gemma, Phi, Qwen, Mistral, Falcon, TinyLlama and more) implemented from scratch, with ready-made recipes to pretrain, finetune, evaluate and deploy them at scale.

    • tpu
    • qlora
    • llama
    • llms
77. 77

    ChatGLM3

    13.6Kzai-org/ChatGLM3 · Python

    ChatGLM3 is a series of open bilingual (Chinese-English) chat large language models released jointly by Zhipu AI and Tsinghua University's KEG Lab, including a 6B-parameter chat model, its base model, and 32K/128K long-context variants.

    • cpu-inference
    • streamlit
    • function-calling
    • bilingual
78. 78

    AI-Research-SKILLs

    13.6KOrchestra-Research/AI-Research-SKILLs · TeX

    It's an open-source library of 98 AI research and engineering skills that turn a Claude Code, Codex, or Gemini CLI agent into a full AI research agent, covering everything from idea generation to paper writing.

    • gpt-5
    • paper-writing
    • grpo
    • ai-research
79. 79

    dinov2

    13.4Kfacebookresearch/dinov2 · Jupyter Notebook

    DINOv2, a self-supervised visual feature learning method from Meta AI's FAIR team, shipped as PyTorch code and pretrained models. Its features plug into classifiers as simple as linear layers across many vision tasks, with no fine-tuning required.

    • imagenet
    • unsupervised-learning
    • self-supervised-learning
    • meta
80. 80

    DiffSynth-Studio

    13.3Kmodelscope/DiffSynth-Studio · Python

    DiffSynth-Studio is an open-source Diffusion model engine built and maintained by the ModelScope Community, covering image, video, and audio generation plus image quality metrics, with support for both inference and training.

    • music-generation
    • model-training
    • diffusion
    • comfyui
81. 81

    TinyZero

    13.2KJiayi-Pan/TinyZero · Python

    A minimal reproduction of DeepSeek R1-Zero: through reinforcement learning on countdown and multiplication tasks, a 3B base LM develops self-verification and search abilities all on its own.

    • experiments
    • llm-training
    • reasoning
    • training
82. 82

    CogVideo

    13.1Kzai-org/CogVideo · Python

    An open-source family of text-to-video and image-to-video models: CogVideoX (2024) and its CogVideoX1.5 upgrade, following CogVideo (ICLR 2023), the first open-source large Transformer-based text-to-video model.

    • image-to-video
    • text-to-video
    • diffusion-models
    • lora
83. 83

    gorilla

    13.1KShishirPatil/gorilla · Python

    Gorilla is a Berkeley research project that trains and evaluates LLMs for calling APIs and tools correctly from natural-language requests. It has grown into a suite covering finetuned models (OpenFunctions), the Berkeley Function Calling Leaderboard (BFCL), an execution runtime (GoEx), a RAG fine-tuning recipe (RAFT) and a CLI tool.

    • claude-api
    • api-documentation
    • function-calling
    • tool-calling
84. 84

    PaddleNLP

    13KPaddlePaddle/PaddleNLP · Python

    PaddleNLP is a large language model (LLM) and small language model (SLM) development toolkit built on the PaddlePaddle deep learning framework, offering efficient training, lossless compression, and high-performance inference for large models.

    • document-intelligence
    • neural-search
    • embedding
    • bert
85. 85

    PaddleFormers

    13KPaddlePaddle/PaddleFormers · Python

    PaddleFormers is a Transformers-style library built on Baidu's PaddlePaddle deep learning framework, giving the PaddlePaddle ecosystem the same kind of model interface and training workflow as Hugging Face Transformers, with full training support for 100+ LLMs and vision-language models.

    • baidu
    • pretraining
    • llm-training
    • model
86. 86

    vision_transformer

    12.7Kgoogle-research/vision_transformer · Jupyter Notebook

    This is Google Research's official JAX/Flax code release for Vision Transformer (ViT) and MLP-Mixer image classification models, including pretrained checkpoints and scripts to fine-tune them on your own data.

    • tpu
    • transfer-learning
    • vision-transformer
    • jax
87. 87

    the-incredible-pytorch

    12.7Kritchieng/the-incredible-pytorch

    A curated list of tutorials, papers, projects, libraries, videos, books and communities related to PyTorch, covering everything from basic deep learning to LLMs, agentic AI, and reinforcement learning.

    • deep-learning-tutorial
    • deep-neural-networks
    • reinforcement-learning
    • quantization
88. 88

    kohya_ss

    12.6Kbmaltais/kohya_ss · Python

    Kohya's GUI is a Gradio-based graphical interface (plus CLI) for Kohya's Stable Diffusion training scripts, letting you fine-tune diffusion models, train LoRA/LoHa/LoKr, Dreambooth, Textual Inversion, and full fine-tuning without hand-writing training commands.

    • controlnet
    • colab
    • stable-diffusion
    • text-to-image
89. 89

    axolotl

    12.6Kaxolotl-ai-cloud/axolotl · Python

    Axolotl is a free, open-source framework that streamlines post-training and fine-tuning of large language models — you describe your run in one YAML config and it drives the whole pipeline.

    • distributed-training
    • moe
    • lora
    • training
90. 90

    OpenLLM

    12.6Kbentoml/OpenLLM · Python

    OpenLLM lets you run open-source LLMs like Llama, DeepSeek, Mistral and Qwen as OpenAI-compatible API endpoints with a single command, including a built-in chat UI and cloud deployment support.

    • llm-ops
    • llama2
    • mistral
    • llm-serving
91. 91

    ai-toolkit

    12.3Kostris/ai-toolkit · Python

    AI Toolkit is an all-in-one training suite for finetuning diffusion models, covering image, video, and audio generation models, with support for the latest models like FLUX, Qwen-Image, Wan 2.1/2.2, and Ace-Step on consumer GPUs.

    • model-training
    • audio-generation
    • stable-diffusion
    • text-to-image
92. 92

    MOSS

    12.3KOpenMOSS/MOSS · Python

    MOSS is an open-source, tool-augmented bilingual (Chinese-English) conversational language model built by Fudan University's OpenMOSS team, released with model weights, training data, and deployment/finetuning code.

    • tool-use
    • text-generation
    • streamlit
    • gradio
93. 93

    FlagEmbedding

    12.3KFlagOpen/FlagEmbedding · Python

    FlagEmbedding (BGE) is a one-stop toolkit from BAAI for retrieval and retrieval-augmented LLMs, providing embedding models, rerankers, finetuning scripts, and evaluation tools for search and RAG.

    • information-retrieval
    • retrieval-augmented-generation
    • vector-search
    • semantic-search
94. 94

    train-llm-from-scratch

    12.2KFareedKhan-dev/train-llm-from-scratch · Python

    A from-scratch tutorial and codebase for training your own LLM end to end: tokenizing raw text, pretraining a GPT-style Transformer, and then post-training it with SFT, a reward model, DPO/ORPO/KTO, PPO and GRPO into an aligned, reasoning-style assistant.

    • dpo
    • ppo
    • instruction-tuning
    • sft
95. 95

    speechbrain

    11.9Kspeechbrain/speechbrain · Python

    An open-source, PyTorch-based toolkit for Conversational AI — the technology behind speech assistants and chatbots. It bundles training recipes and pretrained models for a wide range of speech and text processing tasks.

    • speaker-recognition
    • voice-recognition
    • speaker-diarization
    • asr
96. 96

    ludwig

    11.8Kludwig-ai/ludwig · Python

    Ludwig is a declarative deep learning framework that lets you train, fine-tune, and deploy AI models — from LLM fine-tuning to tabular classification — using a YAML config file and zero boilerplate Python.

    • machinelearning
    • llama2
    • mistral
    • llm-training
97. 97

    Transformers-Tutorials

    11.8KNielsRogge/Transformers-Tutorials · Jupyter Notebook

    A collection of Jupyter notebook demos showing how to use HuggingFace's Transformers library in PyTorch, covering models like BERT, GPT-2, LayoutLM, DETR, Donut and many more.

    • gpt-2
    • bert
    • vision-transformer
    • image-classification
98. 98

    tensorzero

    11.7Ktensorzero/tensorzero · Rust

    TensorZero is an open-source LLMOps platform that combines an LLM gateway, observability, evaluation, optimization, and experimentation tooling into one self-hosted stack.

    • ai-engineering
    • genai
    • gateway
    • ml
99. 99

    MiniCPM

    11.6KOpenBMB/MiniCPM · Jupyter Notebook

    MiniCPM is OpenBMB's family of small, open-source LLMs built for on-device and resource-constrained use. The newest release, MiniCPM5-2B, is a dense 2B-parameter model that reaches open-source state-of-the-art for its size class while staying competitive with much larger 4B-class models.

    • tool-use
    • knowledge-distillation
    • long-context
    • llamacpp
100. 100

     skills

     11.2Khuggingface/skills · Python

     This repo provides modular 'Agent Skills' — SKILL.md definitions that teach AI coding agents (Claude Code, Codex, Gemini CLI, Cursor) how to do Hugging Face ML tasks like managing models/datasets, training, evaluation, and deploying to Spaces or SageMaker.

     • datasets
     • gradio
     • training
     • transformers

Showing the 100 most-starred of 185. See every one in the catalog.

• python2,383
• llm1,483
• machine-learning916
• deep-learning737
• gpu789
• huggingface362
• ai1,955
• pytorch419
• research764
• open-source5,666
• apache-2.01,434
• linux4,184
• inference327
• large-language-models213
• cuda396
• lora87
• benchmark431
• quantization183
• transformer212
• nlp214
• macos3,544
• reinforcement-learning149
• multimodal189
• nvidia328