Large-language-models projects on GitHub

1. 1
   #1 · langflow-ai/langflow

   langflow

   Langflow is a platform for building and deploying AI-powered agents and workflows with a visual, drag-and-drop interface.

   155.8K
2. 2
   #2 · rasbt/LLMs-from-scratch

   LLMs-from-scratch

   This is the official code repository for the book 'Build a Large Language Model (From Scratch)', which teaches you to implement a GPT-like LLM in PyTorch step by step, from tokenization through pretraining and finetuning.

   106.7K
3. 3
   #3 · deepseek-ai/DeepSeek-V3

   DeepSeek-V3

   DeepSeek-V3 is an open-weight Mixture-of-Experts (MoE) language model with 671B total parameters but only 37B activated per token, built for efficient yet high-performing inference and matching leading closed-source models on many benchmarks.

   104.5K

4. 4

   DeepSeek-R1

   91.9Kdeepseek-ai/DeepSeek-R1

   DeepSeek-R1 is an open-source family of reasoning-focused large language models from DeepSeek, trained with large-scale reinforcement learning to handle math, code, and general reasoning at a level comparable to OpenAI's o1.

   • knowledge-distillation
   • open-weights
   • reasoning
   • moe
5. 5

   llm-course

   83.7Kmlabonne/llm-course

   A free, open-source course for getting into Large Language Models (LLMs), combining theory roadmaps with hands-on Colab notebooks covering everything from math fundamentals to fine-tuning and deployment.

   • roadmap
   • llms
   • course
   • jupyter notebook
6. 6

   LlamaFactory

   75.5Khiyouga/LlamaFactory · Python

   LlamaFactory unifies efficient fine-tuning of 100+ large language models and vision-language models in one Python toolkit, published as an ACL 2024 paper.

   • llama3
   • peft
   • qlora
   • instruction-tuning
7. 7

   gpt_academic

   71.5Kbinary-husky/gpt_academic · Python

   GPT Academic is a Python web UI that gives practical interaction tools for GPT/GLM and other LLMs, specialized for reading, polishing and writing academic papers, with modular plugin functions for code analysis and PDF/LaTeX translation.

   • gpt-4
   • latex
   • academic
   • translation
8. 8

   MetaGPT

   70.9KFoundationAgents/MetaGPT · Python

   MetaGPT is a multi-agent framework that simulates a software company: you give it a one-line requirement and it coordinates roles like product manager, architect, project manager, and engineer to output user stories, designs, data structures, APIs, and code.

   • code-generation
   • gpt
   • orchestration
   • agentic-ai
9. 9

   ai-engineering-from-scratch

   70.5Krohitg00/ai-engineering-from-scratch · Python

   A free, open-source AI engineering curriculum with 523 lessons across 20 phases (about 342 hours), teaching you to build AI systems from raw math up to autonomous agent swarms, in Python, TypeScript, Rust, and Julia.

   • swarm-intelligence
   • ai-engineering
   • from-scratch
   • transformers
10. 10

    gpt4free

    66.9Kxtekky/gpt4free · Python

    GPT4Free (g4f) is a community-driven project that aggregates many free and reverse-engineered access points to commercial LLMs (GPT-4, Claude, Gemini, DeepSeek, etc.) and media-generation models, exposing them through one unified Python/JS client, web GUI, and OpenAI-compatible API.

    • chatgpt-api
    • deepseek-r1
    • gpt-4o
    • chatbots
11. 11

    nanoGPT

    63.9Kkarpathy/nanoGPT · Python

    nanoGPT is the simplest, fastest repository for training and finetuning medium-sized GPT language models, written as a minimal rewrite of minGPT.

    • karpathy
    • gpt-2
    • text-generation
    • gpt
12. 12

    minimind

    63.9Kjingyaogong/minimind · Python

    MiniMind is an open-source project that lets you train a tiny large language model (around 64M parameters) completely from scratch, in about 2 hours on a single RTX 3090 for roughly the cost of 3 RMB in GPU rental.

    • large-language-model
    • ppo
    • knowledge-distillation
    • grpo
13. 13

    llama

    59.6Kmeta-llama/llama · Python

    This is Meta's reference inference code for running Llama 2 language models (7B to 70B parameters) locally, letting you load pre-trained or chat fine-tuned weights and generate text completions.

    • model
    • foundation-models
    • language-model
    • llama
14. 14

    dive-into-llms

    56.8KLordog/dive-into-llms · Jupyter Notebook

    It's a free Chinese-language tutorial series called 'Dive into LLMs' (《动手学大模型》) that teaches large language model concepts through hands-on coding exercises, built from Shanghai Jiao Tong University's NLP and AI-security course materials.

    • rlhf
    • jailbreak
    • ai-security
    • reasoning
15. 15

    Flowise

    55.5KFlowiseAI/Flowise · TypeScript

    Flowise is a drag-and-drop visual builder for creating AI agents, chatbots, and LLM workflows (chains, RAG pipelines, multi-agent systems) without hand-coding every integration.

    • agentic-workflow
    • low-code
    • no-code
    • multi-agent-systems
16. 16

    ai-agent-book

    54.6Kbojieli/ai-agent-book · Python

    An open-source book by Li Bojie taking AI agents from design principles to engineering practice, built on the formula Agent = LLM + context + tools; text, figures and labs all live in this repo.

    • experiments
    • epub
    • computer-use
    • llm-agents
17. 17

    grok-1

    52.2Kxai-org/grok-1 · Python

    Grok-1 is the 314B-parameter Mixture-of-Experts language model that xAI opened up; this repository holds the JAX example code for loading and running it.

    • tokenizer
    • xai
    • jax
    • torrent
18. 18

    ray

    44.1Kray-project/ray · Python

    Ray is an open-source framework for scaling AI and Python applications: a core distributed runtime plus a set of AI libraries that simplify ML compute.

    • scaling
    • hyperparameter-optimization
    • distributed-computing
    • parallel-computing
19. 19

    DeepSpeed

    43.2Kdeepspeedai/DeepSpeed · Python

    DeepSpeed is a deep learning optimization library that makes distributed training and inference of very large models easy, efficient and effective — it powered models like MT-530B and BLOOM.

    • intel
    • rocm
    • mixture-of-experts
    • compression
20. 20

    ColossalAI

    41.4Khpcaitech/ColossalAI · Python

    Colossal-AI is an open-source system for training and running large AI models more cheaply, faster and with less hardware, by providing a toolbox of parallelism and memory-optimization techniques.

    • hpc
    • distributed-computing
    • rlhf
    • distributed-training
21. 21

    BitNet

    41.2Kmicrosoft/BitNet · C++

    bitnet.cpp is Microsoft's official inference framework for 1-bit (ternary, 1.58-bit) large language models like BitNet b1.58, letting them run fast on CPUs and GPUs.

    • cpu
    • x86
    • arm
    • on-device
22. 22

    ChatGLM-6B

    40.9Kzai-org/ChatGLM-6B · Python

    ChatGLM-6B is an open bilingual (Chinese-English) dialogue language model with 6.2 billion parameters, based on the General Language Model (GLM) architecture.

    • chatglm
    • open-weights
    • glm
    • bilingual
23. 23

    LightRAG

    40.2KHKUDS/LightRAG · Python

    LightRAG is an open-source, graph-based RAG framework (EMNLP 2025) by HKUDS. It indexes your documents into a knowledge graph plus vector embeddings so you can query them — a lighter, faster alternative to Microsoft GraphRAG.

    • question-answering
    • graphrag
    • genai
    • graph-database
24. 24

    FastChat

    39.5Klm-sys/FastChat · Python

    FastChat is an open platform for training, serving, and evaluating large language model based chatbots. It is the release repo for Vicuna and powers Chatbot Arena (lmarena.ai), which has served over 10 million chat requests for 70+ LLMs.

    • gradio
    • vllm
    • quantization
    • fine-tuning
25. 25

    airllm

    39.1Klyogavin/airllm · Jupyter Notebook

    An open-source Python library that runs huge LLMs on tiny GPUs: a 70B model fits on a single 4GB card without quantization, distillation or pruning — even the 2.8T-parameter Kimi K3 runs in under 4GB.

    • consumer-gpu
    • chinese-nlp
    • qlora
    • mlx
26. 26

    langextract

    39Kgoogle/langextract · Python

    LangExtract is a Python library that uses LLMs to pull structured information out of unstructured text, mapping each extraction back to its exact location in the source document.

    • gemini-pro
    • structured-data
    • gemini-api
    • healthcare
27. 27

    Langchain-Chatchat

    38.7Kchatchat-space/Langchain-Chatchat · Python

    Langchain-Chatchat is an open-source RAG and Agent application that lets you build a local-knowledge-base Q&A chatbot using LLMs like ChatGLM, Qwen or Llama through the LangChain framework.

    • milvus
    • faiss
    • chatglm
    • embedding
28. 28

    prompt-eng-interactive-tutorial

    38.6Kanthropics/prompt-eng-interactive-tutorial · Jupyter Notebook

    This is Anthropic's official interactive tutorial for learning prompt engineering with Claude, teaching how to write effective prompts through lessons and hands-on exercises.

    • educational
    • tool-calling
    • prompt
    • curriculum
29. 29

    ai-engineering-hub

    38.3Kpatchy631/ai-engineering-hub · Jupyter Notebook

    A curated collection of 93+ tutorials and real-world project implementations covering LLMs, RAG systems, and AI agents, organized by difficulty level.

    • ai-engineering
    • retrieval-augmented-generation
    • llms
    • jupyter notebook
30. 30

    LLM101n

    37.5Kkarpathy/LLM101n

    LLM101n is a planned course by Andrej Karpathy that walks through building a 'Storyteller' AI language model end-to-end, from basics all the way to a ChatGPT-like web app, implemented from scratch in Python, C and CUDA.

    • attention
    • tokenization
    • rlhf
    • jax
31. 31

    langfuse

    35.9Klangfuse/langfuse · TypeScript

    Langfuse is an open source LLM engineering platform for tracing, evaluating, and debugging LLM and agent applications, with prompt management and a playground built in.

    • autogen
    • llama-index
    • playground
    • llm-observability
32. 32

    timesfm

    34.6Kgoogle-research/timesfm · Python

    TimesFM is a pretrained time-series foundation model from Google Research used for time-series forecasting, similar in spirit to a language model but for numerical sequences.

    • forecasting
    • deep-neural-networks
    • time-series
    • foundation-models
33. 33

    agentscope

    33.4Kagentscope-ai/agentscope · Python

    AgentScope 2.0 is a production-ready, easy-to-use Python framework for building and running LLM agents. It leans on the model's own reasoning and tool use instead of boxing it in with strict prompts and opinionated orchestration.

    • a2a-protocol
    • voice-agent
    • llm-agent
    • sandboxing
34. 34

    self-llm

    32.5Kdatawhalechina/self-llm · Jupyter Notebook

    Self-llm is a Chinese-language tutorial collection that teaches beginners how to configure environments, deploy, and fine-tune (full-parameter or LoRA) 50+ open-source large language models and multimodal models on Linux.

    • deepseek-r1
    • lmstudio
    • chatglm
    • llama3
35. 35

    fairseq

    32.2Kfacebookresearch/fairseq · Python

    Fairseq is Facebook AI Research's sequence modeling toolkit for training custom models for translation, summarization, language modeling and other text generation tasks, built on PyTorch.

    • self-supervised-learning
    • machine-translation
    • text-generation
    • language-model
36. 36

    storm

    31.7Kstanford-oval/storm · Python

    STORM is an LLM-powered system that researches a topic on the Internet and writes a full-length Wikipedia-like report with citations. Co-STORM extends it with human-AI collaborative knowledge curation.

    • agentic-rag
    • text-generation
    • deep-research
    • retrieval-augmented-generation
37. 37

    awesome-generative-ai-guide

    29.8Kaishwaryanr/awesome-generative-ai-guide · HTML

    A one-stop GitHub hub for generative AI learning: research updates, 90+ free courses, code notebooks, and interview prep materials, all organized around one question — what do you want to do with AI?

    • jupyter-notebook
    • llms
    • papers
    • interview-questions
38. 38

    Hands-On-Large-Language-Models

    29.7KHandsOnLLM/Hands-On-Large-Language-Models · Jupyter Notebook

    The official code repo for the O'Reilly book 'Hands-On Large Language Models', known as the Illustrated LLM Book. It contains a Jupyter notebook for each of the book's 12 chapters.

    • text-classification
    • classification
    • llms
    • semantic-search
39. 39

    llama3

    29.2Kmeta-llama/llama3 · Python

    Meta's official GitHub home for Llama 3: model weights plus minimal code for running inference on pre-trained and instruction-tuned models in 8B and 70B sizes. The repo is now deprecated.

    • instruction-tuning
    • meta
    • ai-safety
    • open-weights
40. 40

    Qwen3

    27.7KQwenLM/Qwen3 · Python

    Qwen3 is a series of open-weight large language models built by the Qwen team at Alibaba Cloud, released as both dense and Mixture-of-Experts (MoE) models from 0.6B up to 235B-A22B parameters, with switchable 'thinking' and 'non-thinking' reasoning modes.

    • alibaba
    • qwen3
    • llamacpp
    • foundation-models
41. 41

    Awesome-LLM

    27.4KHannibal046/Awesome-LLM

    A curated, continuously updated list of resources about Large Language Models (LLMs): milestone and other research papers, training/inference frameworks, open LLM checkpoints, benchmarks, courses, and books.

    • papers
    • natural-language-processing
    • gpt
    • chatgpt
42. 42

    haystack

    26.8Kdeepset-ai/haystack · Python

    An open-source AI orchestration framework for building production-ready LLM applications in Python: modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation.

    • agentic-rag
    • information-retrieval
    • genai
    • retrieval-augmented-generation
43. 43

    12-factor-agents

    26.7Khumanlayer/12-factor-agents · TypeScript

    A written guide of 12 (plus a bonus 13th) engineering principles for building LLM-powered agent software reliable enough for production customers, distilled from the author's experience at HumanLayer and conversations with many SaaS founders.

    • context-window
    • software-architecture
    • system-design
    • llms
44. 44

    open-r1

    26.5Khuggingface/open-r1 · Python

    Open R1 is a fully open effort to reproduce the training pipeline behind DeepSeek-R1, providing scripts to run SFT and GRPO training, generate synthetic reasoning data, and evaluate the resulting reasoning models.

    • sft
    • rlhf
    • model-training
    • distributed-training
45. 45

    Strata

    26.4KNiko1221/Strata · C++

    Strata runs Qwen3.8-Flash-Next, a 125-billion-parameter AI model, on a normal gaming PC with one NVIDIA GPU (12-24GB VRAM) and 64GB of RAM, with a one-click installer for Windows and Linux.

    • llama-cpp
    • speculative-decoding
    • inference-engine
    • mixture-of-experts
46. 46

    MiniGPT-4

    25.6KVision-CAIR/MiniGPT-4 · Python

    This is the open-sourced research code for MiniGPT-4 and MiniGPT-v2, two vision-language models that use a large language model as the interface for understanding and chatting about images.

    • vision-language
    • demo
    • model
    • vlm
47. 47

    TDengine

    25.2Ktaosdata/TDengine · C

    TDengine is an open-source, high-performance, cloud-native, AI-powered time-series database built for IoT, Connected Cars, and Industrial IoT workloads, handling TB-to-PB scale data from billions of sensors.

    • time-series-database
    • tsdb
    • financial-analysis
    • bigdata
48. 48

    gpt-2

    25Kopenai/gpt-2 · Python

    This is OpenAI's official code and release for GPT-2, the language model described in the paper 'Language Models are Unsupervised Multitask Learners'. It bundles the model code with scripts to generate text samples from the released GPT-2 checkpoints.

    • text-generation
    • language-model
    • python3
    • paper
49. 49

    gallery

    25Kgoogle-ai-edge/gallery · Kotlin

    Google AI Edge Gallery is an app that lets you download and run open-source generative AI models, including the Gemma family, directly on your Android phone, iPhone, or Mac — fully offline.

    • function-calling
    • on-device-ai
    • local-ai
    • speech-to-text
50. 50

    minGPT

    25Kkarpathy/minGPT · Python

    minGPT is a minimal PyTorch re-implementation of OpenAI's GPT, covering both training and inference, written to be small and easy to read rather than production-optimized.

    • karpathy
    • text-generation
    • tokenization
    • attention-mechanism
51. 51

    nn-zero-to-hero

    24.8Kkarpathy/nn-zero-to-hero · Jupyter Notebook

    A course by Andrej Karpathy that teaches neural networks from the absolute basics, built around a series of YouTube lectures with accompanying Jupyter notebooks coded live in the videos.

    • karpathy
    • attention-mechanism
    • language-model
    • neural-networks
52. 52

    pytudes

    24.4Knorvig/pytudes · Jupyter Notebook

    Pytudes is Peter Norvig's personal collection of short, deliberately difficult Python programs and Jupyter notebooks, each written to perfect one specific programming skill, in the spirit of a musical étude.

    • python-3
    • colab-notebook
    • practice
    • natural-language-processing
53. 53

    DeepSeek-Coder

    24.3Kdeepseek-ai/DeepSeek-Coder · Python

    DeepSeek Coder is a family of open-source code language models trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese), built for code generation, completion, and infilling.

    • finetuning
    • code-generation
    • vllm
    • quantization
54. 54

    Paddle

    24.1KPaddlePaddle/Paddle · C++

    PaddlePaddle is an open-source deep learning platform — China's first independently developed one, open-sourced since 2016 — spanning a core framework, model libraries, end-to-end dev kits and service platforms.

    • paddlepaddle
    • distributed-training
    • scientific-computing
    • neural-networks
55. 55

    awesome-ai-engineering

    22.4Kdipakkr/awesome-ai-engineering

    A large curated list of AI engineering resources covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems, plus broader learning resources for students (programming languages, hackathons, cybersecurity, blockchain, and more).

    • ai-engineering
    • llmops
    • awesome-lists
    • ai-tools
56. 56

    Qwen

    21.9KQwenLM/Qwen · Python

    The official repo of Qwen (通义千问, Tongyi Qianwen) — Alibaba Cloud's family of chat and pretrained large language models, released in sizes from 1.8B up to 72B parameters on Hugging Face and ModelScope.

    • finetuning
    • flash-attention
    • long-context
    • alibaba
57. 57

    FinGPT

    21.4KAI4Finance-Foundation/FinGPT · Jupyter Notebook

    FinGPT is AI4Finance Foundation's open-source project for financial large language models: trained models are released on HuggingFace, with code for RAG, fine-tuning pipelines and benchmarks built around them.

    • financial-analysis
    • technical-analysis
    • instruction-tuning
    • sentiment-analysis
58. 58

    machine-learning-for-trading

    21.4Kstefan-jansen/machine-learning-for-trading · Jupyter Notebook

    The code repository for Machine Learning for Trading, 3rd Edition by Stefan Jansen: an end-to-end workflow for building, testing, and deploying ML-driven trading strategies, from data sourcing to live execution.

    • gradient-boosting
    • polars
    • trading-strategies
    • investment
59. 59

    awesome-free-chatgpt

    21.3KLiLittleCat/awesome-free-chatgpt · Python

    A continuously updated, community-maintained list of websites that let you use ChatGPT (and other chatbots like Claude, Gemini and DeepSeek) for free or cheaply, often without logging in.

    • gpt-4
    • grok
    • chat
    • chatgpt
60. 60

    gpt-oss

    20.5Kopenai/gpt-oss · Python

    The gpt-oss series: two open-weight language models from OpenAI — gpt-oss-120b and gpt-oss-20b — built for powerful reasoning, agentic tasks, and versatile developer use cases. The repo itself adds reference implementations, tools, and example clients around the models.

    • chain-of-thought
    • lmstudio
    • gpt-oss
    • function-calling
61. 61

    Qwen3-VL

    20.1KQwenLM/Qwen3-VL · Jupyter Notebook

    Qwen3-VL is a family of multimodal vision-language models built by the Qwen team at Alibaba Cloud, combining strong text understanding with deep visual perception, reasoning, and agent capabilities.

    • video-understanding
    • alibaba
    • edge-ai
    • vision-language-model
62. 62

    olmocr

    19.8Kallenai/olmocr · Python

    olmOCR is a toolkit that converts PDFs, PNGs, and JPEGs into clean Markdown or plain text with natural reading order, preserving equations, tables, and handwriting - built primarily to produce training datasets for LLMs.

    • s3
    • training
    • aws
    • dataset
63. 63

    ktransformers

    19.6Kkvcache-ai/ktransformers · Python

    KTransformers is a research framework for efficient inference and fine-tuning of large language models through CPU-GPU heterogeneous computing, letting huge MoE models run on hardware that doesn't have enough VRAM to hold them entirely on GPU.

    • cpu-inference
    • intel
    • sglang
    • amd-gpu
64. 64

    devika

    19.6Kstitionai/devika · Python

    Devika is an open-source agentic AI software engineer that takes a high-level task description, plans and researches it, browses the web for information, and writes the code needed to complete it. It's built as an open alternative to Cognition AI's Devin.

    • groq
    • mistral
    • code-generation
    • autonomous-agents
65. 65

    ml-engineering

    19.5Kstas00/ml-engineering · Python

    An open book on machine learning engineering: methodologies, tools and step-by-step instructions for training, fine-tuning and running inference on large language models and multi-modal (VLM) models, written by the engineer who led the BLOOM-176B training.

    • hpc
    • courses
    • llm-training
    • vlm
66. 66

    tiktoken

    19.5Kopenai/tiktoken · Python

    tiktoken is a fast byte pair encoding (BPE) tokenizer built for use with OpenAI's models, converting text into tokens and back again.

    • encoding
    • tokenization
    • text-processing
    • python-library
67. 67

    Chinese-LLaMA-Alpaca

    18.9Kymcui/Chinese-LLaMA-Alpaca · Python

    Open-source Chinese LLaMA and Alpaca large language models. The base LLaMA was extended with a Chinese vocabulary and further pre-trained on Chinese data, and Alpaca versions were instruction-tuned on Chinese instructions; training and deployment scripts are open too.

    • llama3
    • llama2
    • instruction-tuning
    • pretraining
68. 68

    mamba

    18.9Kstate-spaces/mamba · Python

    Mamba is a state space model architecture for sequence modeling with linear-time scaling. It shows promising performance on information-dense data like language modeling, where earlier subquadratic models fell short of Transformers; this repo is its PyTorch implementation.

    • flash-attention
    • rocm
    • deep-neural-networks
    • amd
69. 69

    Foundations-of-LLMs

    18.3KZJU-LLMs/Foundations-of-LLMs

    An open-source textbook on the foundations of large language models, written by a team at Zhejiang University and freely available as a PDF.

    • in-context-learning
    • chain-of-thought
    • ebook
    • lora
70. 70

    Megatron-LM

    18.2KNVIDIA/Megatron-LM · Python

    NVIDIA's open-source toolkit for training large transformer (LLM) models at scale. It comes as Megatron-LM, a reference setup with ready training scripts, and Megatron Core, a composable library of GPU-optimized building blocks for training models across thousands of GPUs.

    • parallel
    • model-training
    • moe
    • transformers
71. 71

    Awesome-Multimodal-Large-Language-Models

    18.1KBradyFU/Awesome-Multimodal-Large-Language-Models

    A curated, continuously updated list of papers, models, datasets, and benchmarks tracking the latest advances in Multimodal Large Language Models (MLLMs) — models like GPT-4o, Gemini, and VITA that understand images, video, and audio alongside text.

    • in-context-learning
    • chain-of-thought
    • multimodal-ai
    • instruction-tuning
72. 72

    camel

    17.9Kcamel-ai/camel · Python

    CAMEL is an open-source multi-agent framework for building, simulating and studying LLM-powered agents at scale, aimed at finding the 'scaling laws of agents'.

    • multi-agent-systems
    • simulation
    • natural-language-processing
    • memory
73. 73

    aie-book

    17.9Kchiphuyen/aie-book · Jupyter Notebook

    The companion repo for Chip Huyen's book 'AI Engineering' (2025) and a collection of resources for AI engineers: chapter summaries, study notes, prompt examples, case studies. It's a work in progress and keeps growing.

    • hallucination-detection
    • study-guide
    • evaluation
    • jupyter notebook
74. 74

    generative-ai

    17.8KGoogleCloudPlatform/generative-ai · Jupyter Notebook

    A collection of notebooks, code samples and sample apps for building generative AI on Google Cloud with Gemini and its Agent Platform, the evolution of Vertex AI.

    • vertex-ai
    • samples
    • gemini-api
    • google-cloud
75. 75

    Qwen-Agent

    17.2KQwenLM/Qwen-Agent · Python

    Qwen-Agent is a framework for building LLM applications on top of Qwen models, using their instruction following, tool use, planning and memory capabilities. It ships with example apps such as a Browser Assistant and Code Interpreter, and it is the backend that powers Qwen Chat.

    • function-calling
    • retrieval-augmented-generation
    • gradio
    • vllm
76. 76

    Qwen3-Coder

    16.8KQwenLM/Qwen3-Coder · Python

    Qwen3-Coder is the code-focused branch of the Qwen3 large language model family from the Qwen team — open-weight models built for coding and agentic tasks, available in several sizes.

    • code-completion
    • long-context
    • function-calling
    • open-weights
77. 77

    leedl-tutorial

    16.8Kdatawhalechina/leedl-tutorial · Jupyter Notebook

    A free Chinese-language deep learning tutorial (nicknamed the 'Apple Book') based on Prof. Li Hongyi's (Hung-yi Lee) 'Machine Learning' course, covering most major deep learning topics in detail.

    • rnn
    • explainable-ai
    • knowledge-distillation
    • transfer-learning
78. 78

    codellama

    16.2Kmeta-llama/codellama · Python

    This is Meta's official inference code for Code Llama, a family of large language models for code built on Llama 2. The repo itself is a minimal example for loading the models and running generation.

    • meta
    • open-weights
    • llama
    • code-generation
79. 79

    PentestGPT

    16KGreyDGL/PentestGPT · Python

    PentestGPT is an agentic framework that uses large language models to run automated penetration testing and solve CTF challenges, working through staged phases like recon, exploitation and reporting.

    • ctf
    • hacking-tool
    • offensive-security
    • red-team
80. 80

    nano-vllm

    15.9KGeeeekExplorer/nano-vllm · Python

    Nano-vLLM is a lightweight, from-scratch reimplementation of the vLLM inference engine for running large language models, built in roughly 1,200 lines of readable Python.

    • inference-engine
    • llm-inference
    • vllm
    • transformer
81. 81

    gpt-3

    15.7Kopenai/gpt-3

    The official companion repo for the GPT-3 paper 'Language Models are Few-Shot Learners'. GPT-3 is an autoregressive language model with 175 billion parameters — 10x more than any previous non-sparse model — tested on few-shot learning across many NLP tasks.

    • gpt-3
    • pretraining
    • text-generation
    • arxiv
82. 82

    StableLM

    15.7KStability-AI/StableLM · Jupyter Notebook

    StableLM is Stability AI's family of open-source language models, including the StableLM-3B-4E1T model, StableLM-Alpha v1/v2 base and tuned models, and StableVicuna, an RLHF-tuned chatbot built on Vicuna-13B.

    • rlhf
    • model-training
    • language-model
    • llama
83. 83

    OpenMetadata

    15.5Kopen-metadata/OpenMetadata · TypeScript

    OpenMetadata is an open platform that unifies technical metadata, lineage, data quality, ownership and business glossaries into one knowledge graph so both humans and AI agents can discover, trust and reuse context about enterprise data.

    • data-governance
    • context
    • data-quality
    • governance
84. 84

    ChatGLM2-6B

    15.5Kzai-org/ChatGLM2-6B · Python

    ChatGLM2-6B is an open bilingual (Chinese-English) conversational language model with 6 billion parameters, the second generation of ChatGLM-6B from Zhipu AI (Z.ai).

    • chatglm
    • glm
    • bilingual
    • gradio
85. 85

    ChuanhuChatGPT

    15.3KGaiZhenbiao/ChuanhuChatGPT · Python

    ChuanhuChatGPT is a web-based GUI for ChatGPT and many other LLMs, adding extras like agents, file-based Q&A, local model deployment, web search, and GPT fine-tuning on top of a Gradio interface.

    • chatgpt-api
    • midjourney
    • chatglm
    • gemma
86. 86

    llm_interview_note

    15.3Kwdndev/llm_interview_note · HTML

    This is a curated Chinese-language knowledge base of large language model (LLM) concepts and interview questions, aimed at algorithm/application engineers preparing for LLM-related job interviews.

    • interview-prep
    • rlhf
    • function-calling
    • coding-interview
87. 87

    llama3-from-scratch

    15.2Knaklecha/llama3-from-scratch · Jupyter Notebook

    A Jupyter notebook that implements Llama3 entirely from scratch, building up every matrix multiplication by hand instead of calling pre-built transformer modules.

    • attention
    • from-scratch
    • tokenization
    • educational
88. 88

    math

    15Kopenai/math · Lean

    A public catalogue of 719 mathematical manuscripts grouped into 372 families, written by an internal OpenAI model during evaluations on open research problems. About 42% of top-line results already have Lean formalizations.

    • lean
    • theorem-proving
    • research-tools
    • science
89. 89

    RD-Agent

    15Kmicrosoft/RD-Agent · Python

    R&D-Agent is a Microsoft multi-agent framework that automates data-driven R&D: one agent proposes new research ideas and another implements them, applied to quant trading, data mining, Kaggle competitions, paper reproduction, and LLM fine-tuning.

    • data-mining
    • development
    • quant
    • quantitative-finance
90. 90

    OpenMythos

    14.9Kkyegomez/OpenMythos · Python

    OpenMythos is an open-source, speculative PyTorch implementation that tries to reconstruct the internal architecture of Anthropic's Claude ('Mythos') purely from publicly available research papers, not from any leaked or official Anthropic code.

    • gpt-5
    • torch
    • attention
    • claude-ai
91. 91

    DeepLearningExamples

    14.9KNVIDIA/DeepLearningExamples · Jupyter Notebook

    A collection of NVIDIA-maintained, state-of-the-art deep learning reference implementations across computer vision, NLP, recommenders, speech, and more, tuned for reproducible accuracy and performance on NVIDIA Tensor Core GPUs.

    • paddlepaddle
    • tensorflow2
    • mxnet
    • graph-neural-networks
92. 92

    TensorRT-LLM

    14.8KNVIDIA/TensorRT-LLM · Python

    TensorRT LLM is NVIDIA's Python framework for defining large language models (and now visual generation models) and compiling them into highly optimized inference engines that run on NVIDIA GPUs, with specialized kernels and Python/C++ runtimes.

    • blackwell
    • llm-serving
    • speculative-decoding
    • moe
93. 93

    Llama-Chinese

    14.8KLlamaChinese/Llama-Chinese · Python

    Llama-Chinese is a Chinese-language community project built around Meta's Llama models (Llama2, Llama3, Llama4). It provides Chinese pretraining and fine-tuning, a custom Atom model series optimized for Chinese, and resources for training, deploying and using Llama in Chinese for free commercial use.

    • rl
    • chinese-nlp
    • pretraining
    • llama-cpp
94. 94

    fauxpilot

    14.7Kfauxpilot/fauxpilot · Python

    FauxPilot is an open-source, self-hosted alternative to GitHub Copilot that runs SalesForce CodeGen models locally on your own NVIDIA GPU via Triton Inference Server with the FasterTransformer backend.

    • triton
    • openai-api
    • copilot
    • code-generation
95. 95

    lm-evaluation-harness

    14.2KEleutherAI/lm-evaluation-harness · Python

    It is a unified framework for few-shot evaluation of language models across a huge number of standard academic benchmarks.

    • evaluation-framework
    • llm-evaluation
    • language-model
    • vllm
96. 96

    llm-universe

    14.2Kdatawhalechina/llm-universe · Jupyter Notebook

    This is a beginner-focused tutorial course on building large language model (LLM) applications, built around a personal knowledge-base assistant project that walks you through calling LLM APIs, building a vector knowledge base, and assembling a RAG pipeline.

    • streamlit
    • langchain
    • vector-database
    • fastapi
97. 97

    instructor

    14K567-labs/instructor · Python

    Instructor is a Python library that gets reliable structured JSON output from LLMs by defining Pydantic models instead of hand-writing JSON schemas and parsing logic.

    • structured-data
    • elixir
    • pydantic
    • validation
98. 98

    LoRA

    13.9Kmicrosoft/LoRA · Python

    LoRA (loralib) is Microsoft's reference implementation of the paper 'LoRA: Low-Rank Adaptation of Large Language Models'. It lets you fine-tune large models like GPT-2, RoBERTa and DeBERTa by training small low-rank matrices instead of all the original weights.

    • gpt-2
    • gpt-3
    • language-model
    • paper
99. 99

    litgpt

    13.7KLightning-AI/litgpt · Python

    LitGPT is a collection of 20+ high-performance large language models (Llama, Gemma, Phi, Qwen, Mistral, Falcon, TinyLlama and more) implemented from scratch, with ready-made recipes to pretrain, finetune, evaluate and deploy them at scale.

    • tpu
    • qlora
    • llama
    • llms
100. 100

     ChatGLM3

     13.6Kzai-org/ChatGLM3 · Python

     ChatGLM3 is a series of open bilingual (Chinese-English) chat large language models released jointly by Zhipu AI and Tsinghua University's KEG Lab, including a 6B-parameter chat model, its base model, and 32K/128K long-context variants.

     • cpu-inference
     • streamlit
     • function-calling
     • bilingual

Showing the 100 most-starred of 213. See every one in the catalog.

• llm1,483
• python2,383
• machine-learning916
• ai1,955
• deep-learning737
• gpu789
• research764
• open-source5,666
• linux4,184
• huggingface362
• inference327
• benchmark431
• cuda396
• pytorch419
• apache-2.01,434
• fine-tuning185
• quantization183
• transformer212
• mit3,312
• nlp214
• artificial-intelligence267
• nvidia328
• docker1,660
• vllm124