Topics / #gpt-2

GPT 2 projects on GitHub

Early large language model architecture influential in transformer research.

As of , the most-starred GPT 2 projects on GitHub are nanoGPT (63.9K stars), nanochat (58.7K stars) and BettaFish (42.4K stars). GitHub.Locker tracks 7 GPT 2 repositories with 216.1K stars combined. The fastest-growing on October 16 was nanoGPT, with +36 stars in a day.

7Projects
216.1KStars in total
+94Stars in a day
Browse in the catalog →github.com/topics/gpt-2 ↗

Hot right now

Most stars gained in a day · Oct 16

+36

nanoGPT

karpathy/nanoGPT · ★ 63.9K

nanoGPT is the simplest, fastest repository for training and finetuning medium-sized GPT language models, written as a minimal rewrite of minGPT.

+31

nanochat

karpathy/nanochat · ★ 58.7K

A minimal, hackable harness for training your own LLM end to end (tokenization, pretraining, finetuning, evaluation, inference) on a single GPU node, ending in a chatbot you talk to over a CLI.

+21

BettaFish

666ghj/BettaFish · ★ 42.4K

BettaFish (Chinese name 'Weiyu'/微舆) is a from-scratch multi-agent public opinion analysis system that monitors social media and large volumes of public comments, then produces reports to help break information bubbles and support decision-making.

+3

LoRA

microsoft/LoRA · ★ 13.9K

LoRA (loralib) is Microsoft's reference implementation of the paper 'LoRA: Low-Rank Adaptation of Large Language Models'. It lets you fine-tune large models like GPT-2, RoBERTa and DeBERTa by training small low-rank matrices instead of all the original weights.

The all-time top

7 projects · by stars

  1. #1 · karpathy/nanoGPT

    nanoGPT

    nanoGPT is the simplest, fastest repository for training and finetuning medium-sized GPT language models, written as a minimal rewrite of minGPT.

    63.9K
  2. #2 · karpathy/nanochat

    nanochat

    A minimal, hackable harness for training your own LLM end to end (tokenization, pretraining, finetuning, evaluation, inference) on a single GPU node, ending in a chatbot you talk to over a CLI.

    58.7K
  3. #3 · 666ghj/BettaFish

    BettaFish

    BettaFish (Chinese name 'Weiyu'/微舆) is a from-scratch multi-agent public opinion analysis system that monitors social media and large volumes of public comments, then produces reports to help break information bubbles and support decision-making.

    42.4K
  1. 4

    RWKV-LM

    14.8KBlinkDL/RWKV-LM · Python

    RWKV (pronounced 'RwaKuv') is an RNN architecture with transformer-level LLM performance that can also be trained in parallel like GPT. The current generation, RWKV-7 'Goose', is 100% attention-free, linear-time and constant-memory (no kv-cache).

  2. 5

    LoRA

    13.9Kmicrosoft/LoRA · Python

    LoRA (loralib) is Microsoft's reference implementation of the paper 'LoRA: Low-Rank Adaptation of Large Language Models'. It lets you fine-tune large models like GPT-2, RoBERTa and DeBERTa by training small low-rank matrices instead of all the original weights.

  3. 6

    Transformers-Tutorials

    11.8KNielsRogge/Transformers-Tutorials · Jupyter Notebook

    A collection of Jupyter notebook demos showing how to use HuggingFace's Transformers library in PyTorch, covering models like BERT, GPT-2, LayoutLM, DETR, Donut and many more.

  4. 7

    TabNine

    10.8Kcodota/TabNine · Shell

    TabNine is an AI-powered autocompleter that suggests code in any programming language. This repository hosted its backend, and the completion engine itself is closed source.

Often tagged together