Global

I implemented a transformer model from scratch using PyTorch, based on the paper Attention is All You Need. You can use my scripts to train your own billion or million parameter LLM using a single GPU.

This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM and is the official code repository for the book Build a Large Language Model (From Scratch).

Local UI to run and train LLMs and diffusion models. 8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

nanochat is the simplest experimental harness for training LLMs. It is designed to run on a single GPU node, the code is minimal/hackable, and it covers all major LLM stages including tokenization, pretraining, finetuning, evaluation, and inference.

OpenWAM is an open research stack for systematically developing World-Action Models (WAMs). It turns tightly coupled design choices into modular components and controlled experiments. It consists of:

LLMs in simple, pure C/CUDA with no need for 245MB of PyTorch or 107MB of cPython. py. You'll recognize this file as a slightly tweaked nanoGPT, an earlier project of mine.

txt inference code, following DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignment.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. 3, Kimi-K3 and more.

GPT-3: Language Models are Few-Shot Learners

Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用

PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.

Memory Sparse Attention - A scalable, end-to-end trainable latent-memory framework for 100M-token contexts.

Motus2: A Self-Evolving General World Model for Dexterous Manipulation

Like the manacá-da-serra, whose flowers change colour at each stage of maturation, Manacá is intelligence that learns, evolves, and blooms, in Brazilian Portuguese.