Global

Learn AI Engineering! Learn it. Build it. Ship it for others.

AirLLM dramatically reduces inference memory usage, letting 70B large language models run on a single 4GB GPU card — without quantization, distillation, or pruning. 8-Flash-Next (125B) on 6GB, and DeepSeek-V3 (671B) on 12GB. 8-Flash-Next (125B) under 6GB.

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

py starts the SGLang server automatically and sends concurrent requests for an image directory or PDF:

Implementing LLM architectures from scratch in PyTorch

Fine-tune an 8B model on a 4 GB laptop GPU. Layer streaming keeps the frozen base out of VRAM and feeds it to the GPU one decoder layer at a time. 32 GB.

This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM and is the official code repository for the book Build a Large Language Model (From Scratch).

> Prefer to Clone Locally? > > This repository includes 50+ language translations which significantly increases the download size. To clone without translations, use sparse checkout: > > Bash / macOS / Linux: >

pth） - 支持跨不同 GPU 数量恢复（自动调整 step） - 支持 wandb 训练记录连续性（自动恢复同一个 run）

Qwen3-8B on a real BANKING77 item. Every number is a model output.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

MiniCPM-V and MiniCPM-o are multimodal LLM series designed for strong performance and efficient deployment on devices. MiniCPM-V focuses on efficient vision-language understanding across image, video and text inputs.

faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models.

🐧 PenguinHarness: Local-first multi-agent app development platform - create, fine-tune, deploy AI apps automatically!

This release contains training, two inference backends, benchmark scoring, temperature calibration, and a browser demo.

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

> 第八章聚焦 GRPO、OPD、Search-R1 与 ReTool。更多 Agentic RL 算法、训练代码与实验实践，可以前往作者持续维护的另一个仓库 agentic-rl-lab；该仓库更新频率更高，会持续跟进新的算法与环境。

AI联网搜索、文件解析及网页内容抓取等智能体核心能力提供商： 安思派开放平台(Anspire Open)是面向智能体时代的领先的基础设施提供商。我们为开发者提供构建强大智能体所需的核心能力栈，现已上线AI联网搜索【多版本，极具竞争力的价格】、文件解析【限免】及网页内容抓取【限免】、云端浏览器自动化（Anspire Browser Agent）【内测】、多轮改写等服务，持续为智能体连接并操作复杂的数字世界提供坚实基础。可无缝集成至Dify、Coze、元器等主流智能体平台。通过透明点数计费体系与模块化设计，为企业提供高效、低成本的定制化支持，加速智能化升级…

GPU-optimized library for training transformer models at scale

🤗 smolagents: a barebones library for agents that think in code.

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

Hy-MT2 is a family of “fast-thinking” multilingual translation models designed for complex real-world scenarios. 8B, 7B, and 30B-A3B (MoE), all of which support translation among 33 languages and effectively follow translation instructions in multiple languages. 5x.

2026-07-23: ⚡ We released VibeVoice-ASR-BitNet , an edge CPU inference engine for VibeVoice-ASR. 58 GB with real-time inference (RTF Code ] [ Models ] [ Report ]

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

This is an open collection of methodologies, tools and step by step instructions to help with successful training and fine-tuning of large language models and multi-modal models and their inference.

A comprehensive library to post-train foundation models

[2026-03-10] The Canopy Height Maps v2 (CHMv2) model and inference code are now available (more details on downloading the model weights and using the code here). The model weights are also available in Hugging Face Hub and supported by the Hugging Face Transformers library.

Qwen3-ASR is an open-source series of ASR models developed by the Qwen team at Alibaba Cloud, supporting stable multilingual speech/music/song recognition, language detection and timestamp prediction.

app — the end-signal probe, public pages, and the live steered-model lab.

This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations,