I implemented a transformer model from scratch using PyTorch, based on the paper Attention is All You Need. You can use my scripts to train your own billion or million parameter LLM using a single GPU.
Global
#431 · +86 · 1d ·GitHub
Fine-tune an 8B model on a 4 GB laptop GPU. Layer streaming keeps the frozen base out of VRAM and feeds it to the GPU one decoder layer at a time. 32 GB.
Local UI to run and train LLMs and diffusion models. 8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
#2072 · +12 · 1d ·GitHub
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
A comprehensive library to post-train foundation models
#6400 · +1 · 1d ·GitHub
8-Flash-Next is the foundation model developed by Qwen Team, Alibaba Group.
#8392 · +0 · 1d ·GitHub
A conversational drone-swarm choreography agent built on the ReAct paradigm, running on top of a deployed SwarmGPT service. 5B distilled Qwen model (LoRA adapter) that replaces the cloud teacher for choreography planning.