I implemented a transformer model from scratch using PyTorch, based on the paper Attention is All You Need. You can use my scripts to train your own billion or million parameter LLM using a single GPU.
Global
30u30 is an open-source study guide that takes you through the 30 foundational AI papers recommended by Ilya Sutskever — one paper per day. Each paper comes with a full implementation from scratch, detailed notes, interactive exercises with solutions, and visualizations.
《动手学大模型Dive into LLMs》系列编程实践教程
🐧 PenguinHarness: Local-first multi-agent app development platform - create, fine-tune, deploy AI apps automatically!
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
🍔 In addition, ms-swift integrates the latest training technologies, including Megatron parallelism techniques such as TP, PP, CP, EP to accelerate training, as well as numerous GRPO algorithm family reinforcement learning algorithms including: GRPO, DAPO, GSPO, SAPO, CISPO…
A comprehensive library to post-train foundation models
主要记录大语言大模型(LLMs) 算法(应用)工程师相关的知识及面试题
Fine-tuning large pretrained models is often prohibitively costly due to their scale.
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
Scalable RL in real-world settings — Agentic RL for terminal, GUI, SWE, and tool-call settings.
Build your AI agents, chatbots, and RAG applications with HPC-AI Model APIs!
NOTE: this course does not yet exist. It is current being developed by Eureka Labs. Until it is ready I am archiving this repo !!!
A fully open reproduction of DeepSeek-R1. This repo is a work in progress, let's build it together!
This repository contains Stability AI's ongoing development of the StableLM series of language models and will be continuously updated with new checkpoints. The following provides an overview of all currently available models. More coming soon.
YSDA course in Natural Language Processing
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
> A collection of papers and resources related to Large Language Models. > > The organization of papers refers to our survey "A Survey of Large Language Models". ) > > > If you find our survey useful for your research, please cite the following paper:
Low-code framework for building custom LLMs, neural networks, and other AI models
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Halo is an open-source framework built by White Circle for training large language and multimodal models
A local-first trajectory compiler built on DeepSeek Harness.