Topics / #transformer

Transformer projects on GitHub

The transformer neural architecture underlying modern language models.

As of , the most-starred Transformer projects on GitHub are transformers (167.8K stars), whisper (110.8K stars) and LLMs-from-scratch (106.8K stars). GitHub.Locker tracks 212 Transformer repositories with 3.7M stars combined. The fastest-growing on October 16 was colibri, with +222 stars in a day.

212Projects
3.7MStars in total
+2.3KStars in a day
Browse in the catalog →github.com/topics/transformer ↗

Hot right now

Most stars gained in a day · Oct 16

+222

colibri

JustVugg/colibri · ★ 42.6K

Colibri is an open-source engine for running frontier mixture-of-experts (MoE) language models on hardware you already own — written in pure C with zero dependencies.

+150

StartLux-Decision

StartLuxLabs/StartLux-Decision · ★ 648

StartLux-Decision is a family of typed decision models (five dense sizes from 0.8B to 27B plus a 35B-A3B mixture-of-experts) that answer a question with a probability for each option instead of generating text.

+120

Hands-On-Large-Language-Models

HandsOnLLM/Hands-On-Large-Language-Models · ★ 29.7K

The official code repo for the O'Reilly book 'Hands-On Large Language Models', known as the Illustrated LLM Book. It contains a Jupyter notebook for each of the book's 12 chapters.

+111

VisionHOPE

PSRben/VisionHOPE · ★ 1.3K

VisionHOPE is the official PyTorch implementation of a visual backbone built on self-referential nested learning (SRNL), supporting ImageNet-1K classification, COCO detection/instance segmentation, and ADE20K semantic segmentation.

The all-time top

Top 100 of 212 · by stars

  1. #1 · huggingface/transformers

    transformers

    Transformers is Hugging Face's model-definition framework for state-of-the-art machine learning models across text, vision, audio, video, and multimodal tasks, usable for both inference and training.

    167.8K
  2. #2 · openai/whisper

    whisper

    Whisper is a general-purpose speech recognition model trained on a large, diverse dataset with weak supervision. It can perform multilingual transcription, translate speech into English, and identify the spoken language.

    110.8K
  3. #3 · rasbt/LLMs-from-scratch

    LLMs-from-scratch

    This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

    106.8K
  1. 4

    DeepSeek-V3

    104.5Kdeepseek-ai/DeepSeek-V3 · Python

    DeepSeek-V3 is an open-weight Mixture-of-Experts (MoE) language model with 671B total parameters but only 37B activated per token, built for efficient yet high-performing inference and matching leading closed-source models on many benchmarks.

  2. 5

    vllm

    94Kvllm-project/vllm · Python

    vLLM is a library for fast LLM inference and serving, built around PagedAttention for efficient memory management of attention keys and values.

  3. 6

    DeepSeek-R1

    91.9Kdeepseek-ai/DeepSeek-R1

    DeepSeek-R1 is an open-source family of reasoning-focused large language models from DeepSeek, trained with large-scale reinforcement learning to handle math, code, and general reasoning at a level comparable to OpenAI's o1.

  4. 7

    llm-course

    83.8Kmlabonne/llm-course

    A free, open-source course for getting into Large Language Models (LLMs), combining theory roadmaps with hands-on Colab notebooks covering everything from math fundamentals to fine-tuning and deployment.

  5. 8

    models

    77.6Ktensorflow/models · Python

    TensorFlow Model Garden is a repository of state-of-the-art model implementations and examples built with TensorFlow, covering officially maintained models, research models, and a curated community list.

  6. 9

    AI-For-Beginners

    69.9Kmicrosoft/AI-For-Beginners · Jupyter Notebook

    A free 12-week, 24-lesson curriculum from Microsoft that teaches Artificial Intelligence fundamentals through practical lessons, quizzes, and labs.

  7. 10

    annotated_deep_learning_paper_implementations

    67.6Klabmlai/annotated_deep_learning_paper_implementations · Python

    A collection of 60+ PyTorch implementations of deep learning papers, each annotated with side-by-side explanatory notes so you can read the code and the math/explanation together.

  8. 11

    nanoGPT

    63.9Kkarpathy/nanoGPT · Python

    nanoGPT is the simplest, fastest repository for training and finetuning medium-sized GPT language models, written as a minimal rewrite of minGPT.

  9. 12

    DeepLearning-500-questions

    57.7Kscutan90/DeepLearning-500-questions · JavaScript

    It is a Chinese-language Q&A style reference covering probability, linear algebra, machine learning, deep learning, and computer vision, organized as answers to 500+ commonly asked questions across 18 chapters and over 500,000 characters. It is also sold in print as 'Deep Learning 500 Questions — AI Engineer Interview Guide' (深度学习500问——AI工程师面试宝典).

  10. 13

    segment-anything

    55Kfacebookresearch/segment-anything · Jupyter Notebook

    This is Meta AI's Segment Anything Model (SAM), a foundation model that produces object masks for images from prompts like points or boxes, or automatically generates masks for every object in an image.

  11. 14

    whisper.cpp

    54.5Kggml-org/whisper.cpp · C++

    whisper.cpp is a high-performance C/C++ port of OpenAI's Whisper automatic speech recognition (ASR) model, letting you transcribe audio to text without Python or heavy ML frameworks.

  12. 15

    grok-1

    52.2Kxai-org/grok-1 · Python

    Grok-1 is the 314B-parameter Mixture-of-Experts language model that xAI opened up; this repository holds the JAX example code for loading and running it.

  13. 16

    colibri

    42.6KJustVugg/colibri · C

    Colibri is an open-source engine for running frontier mixture-of-experts (MoE) language models on hardware you already own — written in pure C with zero dependencies.

  14. 17

    Kronos

    40.9Kshiyu-coder/Kronos · Python

    Kronos is an open-source foundation model for financial candlestick (K-line) data, pretrained on data from over 45 global exchanges to produce price/volume forecasts.

  15. 18

    bert

    40Kgoogle-research/bert · Python

    Google's official TensorFlow implementation of BERT together with pre-trained checkpoints — a method for pre-training language representations that set state-of-the-art results on a wide range of NLP tasks, from SQuAD question answering to natural language inference.

  16. 19

    Deep-Learning-Papers-Reading-Roadmap

    39.6Kfloodsung/Deep-Learning-Papers-Reading-Roadmap · Python

    A curated, structured reading roadmap of landmark deep learning papers, organized to guide a newcomer from history and basics through methods and applications to the state of the art.

  17. 20

    bark

    39.3Ksuno-ai/bark · Jupyter Notebook

    Bark is a transformer-based text-to-audio model from Suno that generates realistic, multilingual speech plus music, background noise, and sound effects from text prompts.

  18. 21

    LLM101n

    37.5Kkarpathy/LLM101n

    LLM101n is a planned course by Andrej Karpathy that walks through building a 'Storyteller' AI language model end-to-end, from basics all the way to a ChatGPT-like web app, implemented from scratch in Python, C and CUDA.

  19. 22

    sglang

    37.2Ksgl-project/sglang · Python

    SGLang is a high-performance serving framework for large language models and multimodal models, built to deliver low-latency, high-throughput inference from a single GPU up to large distributed clusters.

  20. 23

    pytorch-image-models

    37.2Khuggingface/pytorch-image-models · Python

    PyTorch Image Models (timm) — the largest collection of PyTorch image encoders and backbones, shipped with pretrained weights plus train, eval, inference and export scripts.

  21. 24

    HanLP

    36.5Khankcs/HanLP · Python

    HanLP is a production-oriented, multilingual NLP toolkit built on dual PyTorch/TensorFlow 2.x engines, supporting 130 languages with ten joint tasks such as tokenization, POS tagging, NER, dependency and constituency parsing, semantic role labeling, and text classification.

  22. 25

    heretic

    35.7Kp-e-w/heretic · Python

    Heretic is a command-line tool that automatically removes censorship (safety alignment) from transformer-based language models using directional ablation combined with an Optuna-powered parameter optimizer, without any training.

  23. 26

    timesfm

    34.6Kgoogle-research/timesfm · Python

    TimesFM is a pretrained time-series foundation model from Google Research used for time-series forecasting, similar in spirit to a language model but for numerical sequences.

  24. 27

    happy-llm

    34.4Kdatawhalechina/happy-llm · Jupyter Notebook

    Happy-LLM is Datawhale's free open-source LLM course: a systematic tutorial that goes from NLP basics and the Transformer architecture to building and training your first large language model, then applying it with RAG and agents.

  25. 28

    paper-reading

    34Kmli/paper-reading

    It's a curated reading list for deep learning: each entry is a recorded lecture that walks through a paper paragraph by paragraph, from classics like CLIP and GPT-3 to recent ones like Llama 3.1 and Sora.

  26. 29

    spaCy

    34Kexplosion/spaCy · Python

    spaCy is a library for advanced Natural Language Processing in Python and Cython, designed from day one for real products. It ships pretrained pipelines and supports tokenization and training for 70+ languages.

  27. 30

    x-algorithm

    33.7Kxai-org/x-algorithm · Rust

    This is the open-source code behind X's (Twitter's) 'For You' feed algorithm. It finds, scores, ranks, and filters which posts each viewer sees, blending posts from followed accounts with ML-discovered out-of-network content.

  28. 31

    fish-speech

    33.2Kfishaudio/fish-speech · Python

    Fish Speech (Fish Audio S2) is a state-of-the-art open-source text-to-speech system that generates natural, emotionally rich speech in 80+ languages, led by the flagship S2-Pro model that combines a Dual-AR architecture with reinforcement-learning alignment.

  29. 32

    mmdetection

    33Kopen-mmlab/mmdetection · Python

    MMDetection is an open source object detection toolbox built on PyTorch, part of the OpenMMLab project, that supports object detection, instance segmentation, panoptic segmentation, and semi-supervised detection.

  30. 33

    pytorch-tutorial

    32.5Kyunjey/pytorch-tutorial · Python

    This is a collection of PyTorch tutorial code for deep learning researchers, covering models from basics to advanced topics, each implemented in under 30 lines of code where possible.

  31. 34

    fairseq

    32.2Kfacebookresearch/fairseq · Python

    Fairseq is Facebook AI Research's sequence modeling toolkit for training custom models for translation, summarization, language modeling and other text generation tasks, built on PyTorch.

  32. 35

    pytorch-lightning

    31.4KLightning-AI/pytorch-lightning · Python

    PyTorch Lightning is a deep learning framework for pretraining and finetuning AI models of any size, scaling from a single CPU to thousands of GPUs or TPUs without changing your model code.

  33. 36

    Hands-On-Large-Language-Models

    29.7KHandsOnLLM/Hands-On-Large-Language-Models · Jupyter Notebook

    The official code repo for the O'Reilly book 'Hands-On Large Language Models', known as the Illustrated LLM Book. It contains a Jupyter notebook for each of the book's 12 chapters.

  34. 37

    Awesome-LLM

    27.4KHannibal046/Awesome-LLM

    A curated, continuously updated list of resources about Large Language Models (LLMs): milestone and other research papers, training/inference frameworks, open LLM checkpoints, benchmarks, courses, and books.

  35. 38

    deep-learning-for-image-processing

    26.4KWZMIAOMIAO/deep-learning-for-image-processing · Python

    A video-based deep learning course that walks through classic computer-vision architectures for image classification, object detection, segmentation and keypoint detection, pairing each network with a lecture and runnable code.

  36. 39

    faster-whisper

    25.9KSYSTRAN/faster-whisper · Python

    A Python reimplementation of OpenAI's Whisper model on CTranslate2, a fast Transformer inference engine — up to 4x faster than the original at the same accuracy, using less memory, with optional 8-bit quantization on CPU and GPU.

  37. 40

    flash-attention

    25.2KDao-AILab/flash-attention · Python

    The official implementation of FlashAttention and FlashAttention-2 — GPU kernels that compute exact attention faster and with less memory than standard PyTorch attention.

  38. 41

    gpt-2

    25Kopenai/gpt-2 · Python

    This is OpenAI's official code and release for GPT-2, the language model described in the paper 'Language Models are Unsupervised Multitask Learners'. It bundles the model code with scripts to generate text samples from the released GPT-2 checkpoints.

  39. 42

    minGPT

    25Kkarpathy/minGPT · Python

    minGPT is a minimal PyTorch re-implementation of OpenAI's GPT, covering both training and inference, written to be small and easy to read rather than production-optimized.

  40. 43

    nn-zero-to-hero

    24.8Kkarpathy/nn-zero-to-hero · Jupyter Notebook

    A course by Andrej Karpathy that teaches neural networks from the absolute basics, built around a series of YouTube lectures with accompanying Jupyter notebooks coded live in the videos.

  41. 44

    DeepSeek-Coder

    24.3Kdeepseek-ai/DeepSeek-Coder · Python

    DeepSeek Coder is a family of open-source code language models trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese), built for code generation, completion, and infilling.

  42. 45

    examples

    24.1Kpytorch/examples · Python

    A curated set of short, standalone PyTorch example projects covering computer vision, text, and reinforcement learning, each meant to be emulated in your own work.

  43. 46

    best-of-ml-python

    23.8Klukasmasuch/best-of-ml-python

    A curated, ranked index of top open-source machine learning libraries for Python, covering areas like deep learning, NLP, AutoML and data visualization, generated and refreshed automatically.

  44. 47

    learnopencv

    23.2Kspmallick/learnopencv · Jupyter Notebook

    This is the companion code repository for the LearnOpenCV.com blog, containing C++ and Python examples that accompany articles on computer vision, deep learning, and AI research.

  45. 48

    CVPR2026-Papers-with-Code

    22.9Kamusi/CVPR2026-Papers-with-Code

    A curated, continuously updated index of CVPR 2026 papers and their open-source code implementations, organized by computer vision topic (object detection, segmentation, 3D reconstruction, diffusion models, multimodal LLMs, etc.).

  46. 49

    onnxruntime

    22.1Kmicrosoft/onnxruntime · C++

    ONNX Runtime is a cross-platform, high performance ML accelerator for inference and training. It runs models from PyTorch, TensorFlow/Keras and classical ML libraries like scikit-learn, LightGBM and XGBoost.

  47. 50

    The-Art-Of-Programming-By-July-2nd

    21.5Kjulycoding/The-Art-Of-Programming-By-July-2nd · C

    This is a Chinese book-and-notes repository on programming interview questions, algorithms and data structures, originally a blog series that grew into the published book '编程之法:面试和算法心得' (The Art of Programming). It also bundles machine learning notes (SVM, CNN, RNN/LSTM, BERT, ChatGPT) collected from the author's other blog series.

  48. 51

    candle

    21.2Khuggingface/candle · Rust

    Candle is a minimalist machine learning framework for Rust, focused on performance (including GPU support) and ease of use. It ships with ready examples for LLMs, speech, vision and text-to-image models.

  49. 52

    deep-learning-with-python-notebooks

    20.3Kfchollet/deep-learning-with-python-notebooks · Jupyter Notebook

    Companion Jupyter notebooks for the book 'Deep Learning with Python' by Francois Chollet (and Matthew Watson for the 3rd edition, 2025), implementing all its code samples, plus legacy notebooks for the 2nd edition (2021) and 1st edition (2017).

  50. 53

    Qwen3-VL

    20.1KQwenLM/Qwen3-VL · Jupyter Notebook

    Qwen3-VL is a family of multimodal vision-language models built by the Qwen team at Alibaba Cloud, combining strong text understanding with deep visual perception, reasoning, and agent capabilities.

  51. 54

    sam2

    20Kfacebookresearch/sam2 · Jupyter Notebook

    SAM 2 (Segment Anything Model 2) is Meta's foundation model for promptable segmentation of objects in both images and videos, extending the original Segment Anything Model with a streaming memory architecture for real-time video tracking.

  52. 55

    ktransformers

    19.6Kkvcache-ai/ktransformers · Python

    KTransformers is a research framework for efficient inference and fine-tuning of large language models through CPU-GPU heterogeneous computing, letting huge MoE models run on hardware that doesn't have enough VRAM to hold them entirely on GPU.

  53. 56

    nndl

    19.4Knndl/nndl

    The official home of Qiu Xipeng's Chinese textbook 'Neural Network and Deep Learning': it hosts free e-book PDFs, chapter listings, learning resources and errata for the 2nd edition and the new general-audience edition.

  54. 57

    sentence-transformers

    19.2Khuggingface/sentence-transformers · Python

    Sentence Transformers is a framework for computing embeddings and using or training state-of-the-art embedding and reranker models, covering dense sentence embeddings, cross-encoder rerankers, sparse encoders, and multi-vector (ColBERT-style) encoders.

  55. 58

    Foundations-of-LLMs

    18.3KZJU-LLMs/Foundations-of-LLMs

    An open-source textbook on the foundations of large language models, written by a team at Zhejiang University and freely available as a PDF.

  56. 59

    CodeFormer

    18.2Ksczhou/CodeFormer · Python

    An AI face-restoration model and tool from a NeurIPS 2022 paper by S-Lab, Nanyang Technological University: it rebuilds clear, realistic faces from blurry, low-quality, or old photos using a codebook-lookup transformer.

  57. 60

    lingbot-map

    18.1KRobbyant/lingbot-map · Python

    LingBot-Map is a feed-forward 3D foundation model for streaming 3D reconstruction, built around a Geometric Context Transformer that was a ECCV 2026 Best Paper Award candidate.

  58. 61

    DeepLearning

    17.8KMikoto10032/DeepLearning · Jupyter Notebook

    A Chinese-language deep learning tutorial — a huge curated collection of links to courses, books, lecture notes, surveys and code, taking you from math basics through CNNs, GANs, RNNs and GNNs to Kaggle practice and interview prep.

  59. 62

    ML-NLP

    17.8KNLP-LOVE/ML-NLP · Jupyter Notebook

    A curated, structured collection of machine learning, deep learning, and NLP interview knowledge points with accompanying code implementations, organized chapter by chapter (linear regression through BERT and XLNet).

  60. 63

    Janus

    17.8Kdeepseek-ai/Janus · Python

    Janus is DeepSeek's family of open multimodal AI models (Janus, Janus-Pro, JanusFlow). One model both understands images and text and generates images from a text prompt.

  61. 64

    deeplearning-models

    17.6Krasbt/deeplearning-models · Jupyter Notebook

    A large collection of Jupyter Notebooks implementing various deep learning architectures, models, and training tips for TensorFlow and PyTorch.

  62. 65

    tensor2tensor

    17.5Ktensorflow/tensor2tensor · Python

    A library of deep learning models and datasets from researchers and engineers on the Google Brain team, built to make deep learning more accessible and speed up ML research.

  63. 66

    leedl-tutorial

    16.8Kdatawhalechina/leedl-tutorial · Jupyter Notebook

    A free Chinese-language deep learning tutorial (nicknamed the 'Apple Book') based on Prof. Li Hongyi's (Hung-yi Lee) 'Machine Learning' course, covering most major deep learning topics in detail.

  64. 67

    LaTeX-OCR

    16.6Klukas-blecher/LaTeX-OCR · Python

    A learning-based OCR system: feed it an image of a math formula and it returns the matching LaTeX code.

  65. 68

    numpy-ml

    16.3Kddbourgin/numpy-ml · Python

    A collection of machine learning algorithms — Gaussian mixture models, HMMs, neural networks, tree ensembles, reinforcement learning agents and more — implemented from scratch in pure NumPy.

  66. 69

    TensorFlow-Course

    16.3Kinstillai/TensorFlow-Course · Jupyter Notebook

    A curated collection of simple, ready-to-use TensorFlow tutorials, covering topics from basic tensors and automatic differentiation to CNNs, custom training loops, and TFRecords.

  67. 70

    MNN

    16.2Kalibaba/MNN · C++

    MNN is a lightweight, high-performance deep learning inference (and training) engine built by Alibaba, used to run models like LLMs, diffusion models, and CNNs efficiently on mobile, embedded, and edge devices.

  68. 71

    Swin-Transformer

    16.1Kmicrosoft/Swin-Transformer · Python

    The official Microsoft implementation of the Swin Transformer paper and its follow-ups: a hierarchical vision Transformer that computes attention with shifted windows and serves as a general-purpose backbone for computer vision tasks.

  69. 72

    nano-vllm

    15.9KGeeeekExplorer/nano-vllm · Python

    Nano-vLLM is a lightweight, from-scratch reimplementation of the vLLM inference engine for running large language models, built in roughly 1,200 lines of readable Python.

  70. 73

    gpt-3

    15.7Kopenai/gpt-3

    The official companion repo for the GPT-3 paper 'Language Models are Few-Shot Learners'. GPT-3 is an autoregressive language model with 175 billion parameters — 10x more than any previous non-sparse model — tested on few-shot learning across many NLP tasks.

  71. 74

    StableLM

    15.7KStability-AI/StableLM · Jupyter Notebook

    StableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.

  72. 75

    F5-TTS

    15.4KSWivid/F5-TTS · Python

    F5-TTS is a text-to-speech system that generates fluent, faithful speech using flow matching with a Diffusion Transformer (ConvNeXt V2 backbone), and it supports cloning a speaker's voice from a short reference clip.

  73. 76

    detr

    15.3Kfacebookresearch/detr · Python

    DETR is Facebook AI Research's object detection model that treats detection as a direct set prediction problem using a Transformer encoder-decoder, replacing the usual hand-crafted detection pipeline (anchors, NMS, etc).

  74. 77

    llm_interview_note

    15.3Kwdndev/llm_interview_note · HTML

    This is a curated Chinese-language knowledge base of large language model (LLM) concepts and interview questions, aimed at algorithm/application engineers preparing for LLM-related job interviews.

  75. 78

    llama3-from-scratch

    15.2Knaklecha/llama3-from-scratch · Jupyter Notebook

    A Jupyter notebook that implements Llama3 entirely from scratch, building up every matrix multiplication by hand instead of calling pre-built transformer modules.

  76. 79

    nlp-tutorial

    14.9Kgraykode/nlp-tutorial · Jupyter Notebook

    A collection of short PyTorch implementations covering core NLP and deep learning models, from word embeddings to Transformers and BERT, meant as a study resource.

  77. 80

    OpenMythos

    14.9Kkyegomez/OpenMythos · Python

    OpenMythos is an open-source, speculative PyTorch implementation that tries to reconstruct the internal architecture of Anthropic's Claude ('Mythos') purely from publicly available research papers, not from any leaked or official Anthropic code.

  78. 81

    DeepLearningExamples

    14.9KNVIDIA/DeepLearningExamples · Jupyter Notebook

    A collection of NVIDIA-maintained, state-of-the-art deep learning reference implementations across computer vision, NLP, recommenders, speech, and more, tuned for reproducible accuracy and performance on NVIDIA Tensor Core GPUs.

  79. 82

    TensorRT-LLM

    14.8KNVIDIA/TensorRT-LLM · Python

    TensorRT LLM is NVIDIA's Python framework for defining large language models (and now visual generation models) and compiling them into highly optimized inference engines that run on NVIDIA GPUs, with specialized kernels and Python/C++ runtimes.

  80. 83

    RWKV-LM

    14.8KBlinkDL/RWKV-LM · Python

    RWKV (pronounced 'RwaKuv') is an RNN architecture with transformer-level LLM performance that can also be trained in parallel like GPT. The current generation, RWKV-7 'Goose', is 100% attention-free, linear-time and constant-memory (no kv-cache).

  81. 84

    csm

    14.7KSesameAILabs/csm · Python

    CSM (Conversational Speech Model) is a speech generation model from Sesame that turns text and audio input into spoken audio by producing RVQ audio codes, using a Llama backbone plus a smaller audio decoder.

  82. 85

    dalle-mini

    14.7Kborisdayma/dalle-mini · Python

    DALL·E Mini is an open-source model that generates images from a text prompt, built as a smaller, reproducible version of OpenAI's DALL·E.

  83. 86

    fauxpilot

    14.7Kfauxpilot/fauxpilot · Python

    FauxPilot is an open-source, self-hosted alternative to GitHub Copilot that runs SalesForce CodeGen models locally on your own NVIDIA GPU via Triton Inference Server with the FasterTransformer backend.

  84. 87

    FreeToken

    14.6KFlashML-org/FreeToken · Python

    FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine built to run frontier-scale open-weight models, including 290B+ parameter models, on consumer hardware like gaming PCs.

  85. 88

    vggt

    14.5Kfacebookresearch/vggt · Python

    VGGT (Visual Geometry Grounded Transformer) is a feed-forward neural network that directly infers a scene's 3D attributes - camera intrinsics/extrinsics, depth maps, point maps, and 3D point tracks - from one, a few, or hundreds of images, in seconds. It won the CVPR 2025 Best Paper Award.

  86. 89

    openpi

    14.3KPhysical-Intelligence/openpi · Python

    openpi is a collection of open-source vision-language-action (VLA) models for robotics from the Physical Intelligence team, including pi0, pi0-FAST, and pi0.5, with pretrained checkpoints and code for fine-tuning and running them.

  87. 90

    lm-evaluation-harness

    14.3KEleutherAI/lm-evaluation-harness · Python

    It is a unified framework for few-shot evaluation of language models across a huge number of standard academic benchmarks.

  88. 91

    open_clip

    14.2Kmlfoundations/open_clip · Python

    OpenCLIP is an open source implementation of OpenAI's CLIP model for training and using contrastive image-text (and now audio-text) models for tasks like zero-shot classification.

  89. 92

    LoRA

    13.9Kmicrosoft/LoRA · Python

    LoRA (loralib) is Microsoft's reference implementation of the paper 'LoRA: Low-Rank Adaptation of Large Language Models'. It lets you fine-tune large models like GPT-2, RoBERTa and DeBERTa by training small low-rank matrices instead of all the original weights.

  90. 93

    litgpt

    13.7KLightning-AI/litgpt · Python

    LitGPT is a collection of 20+ high-performance large language models (Llama, Gemma, Phi, Qwen, Mistral, Falcon, TinyLlama and more) implemented from scratch, with ready-made recipes to pretrain, finetune, evaluate and deploy them at scale.

  91. 94

    dinov2

    13.4Kfacebookresearch/dinov2 · Jupyter Notebook

    DINOv2, a self-supervised visual feature learning method from Meta AI's FAIR team, shipped as PyTorch code and pretrained models. Its features plug into classifiers as simple as linear layers across many vision tasks, with no fine-tuning required.

  92. 95

    CogVideo

    13.1Kzai-org/CogVideo · Python

    An open-source family of text-to-video and image-to-video models: CogVideoX (2024) and its CogVideoX1.5 upgrade, following CogVideo (ICLR 2023), the first open-source large Transformer-based text-to-video model.

  93. 96

    FlashMLA

    13.1Kdeepseek-ai/FlashMLA · C++

    FlashMLA is DeepSeek's library of highly optimized CUDA attention kernels (Multi-head Latent Attention) that power the DeepSeek-V3 and DeepSeek-V3.2 models, covering both dense and sparse attention for prefill and decoding.

  94. 97

    PaddleFormers

    13KPaddlePaddle/PaddleFormers · Python

    PaddleFormers is a Transformers-style library built on Baidu's PaddlePaddle deep learning framework, giving the PaddlePaddle ecosystem the same kind of model interface and training workflow as Hugging Face Transformers, with full training support for 100+ LLMs and vision-language models.

  95. 98

    Time-Series-Library

    13Kthuml/Time-Series-Library · Python

    TSLib is an open-source Python library for deep learning researchers working on time series: a clean codebase to evaluate advanced deep time series models or develop your own, with around 13,000 GitHub stars.

  96. 99

    open-llms

    12.9Keugeneyan/open-llms

    A curated list of open large language models (LLMs) that are licensed for commercial use, such as Apache 2.0, MIT, or OpenRAIL-M licenses.

  97. 100

    dio

    12.8Kcfug/dio · Dart

    dio is a powerful open-source HTTP client for Dart and Flutter, with around 12.8k GitHub stars. This repo is its base monorepo, holding the core package, its plugins and example apps.

Showing the 100 most-starred of 212. See every one in the catalog.

Often tagged together