Global

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.

A high-throughput and memory-efficient inference and serving engine for LLMs

3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

PyTorch is a Python package that provides two high-level features: - Tensor computation (like NumPy) with strong GPU acceleration - Deep neural networks built on a tape-based autograd system

Koharu introduces a local-first workflow for manga translation, utilizing the power of ML to automate the process. It combines the capabilities of object detection, OCR, inpainting, and LLMs to create a seamless translation experience.

(When code is generated by prompting either directly to an LLM or through "comment prompting".)

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

The Open Source Strix Halo AI engine. 56tg tok/s single user with DFlash2

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

⭐ If LMCache helps you serve LLMs faster and cheaper, give us a star — it helps more teams discover the project.

Run Bonsai 2 27B locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU.

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

You input a raw green screen frame, and the neural network completely separates the foreground object from the green screen.

The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

dll) in Windows games on AMD Radeon GPUs under Linux and Proton. The game asks for DLSS as usual; the DLSS network runs on the AMD GPU through ZLUDA (CUDA on ROCm/HIP), with the heaviest DLSS kernels replaced by hand-written RDNA3 and RDNA4 code.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Apache TVM is an open machine learning compilation framework, following the following principles:

Apollo is a high performance, flexible architecture which accelerates the development, testing, and deployment of Autonomous Vehicles.

MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone's platforms.

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

ROCm™ Hyperloom is a multi-agent harness that autonomously optimizes inference on AMD Instinct™ GPUs.

FaceSwap is a tool that utilizes deep learning to recognize and swap faces in pictures and videos.

CuPy is a NumPy/SciPy-compatible array library for GPU-accelerated computing with Python. CuPy acts as a drop-in replacement to run existing NumPy/SciPy code on NVIDIA CUDA or AMD ROCm platforms.

CAUTION] > text-generation-inference is now in maintenance mode. Going forward, we will accept pull requests for minor bug fixes, documentation improvements and lightweight maintenance tasks.

Mamba is a new state space model architecture showing promising performance on information-dense data such as language modeling, where previous subquadratic models fall short of Transformers.

xFormers is: - Customizable building blocks: Independent/customizable building blocks that can be used without boilerplate code. The components are domain-agnostic and xFormers is used by researchers in vision, NLP and more.

8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, paired benchmarks, probe tool.

Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.