The official Ollama Docker image ollama/ollama is available on Docker Hub.
Global
#308 · +102 · 1d ·GitHub
TokenSpeed is a speed-of-light LLM inference engine designed for agentic workloads, with TensorRT-LLM-level performance and vLLM-level usability. The goal is to be the most performant inference engine for production agentic workloads.
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a high-performance serving framework for large language models and multimodal models.
《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
Welcome to the gpt-oss series, OpenAI's open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases.
#3741 · +4 · 1d ·GitHub
The Ollama Python library provides the easiest way to integrate Python 3.8+ projects with Ollama.
#3847 · +4 · 1d ·GitHub
Uncensored AI models or those fine-tuned for cybersecurity tasks.
DFlash is a lightweight block diffusion model designed for speculative decoding. It enables efficient and high-quality parallel drafting.
[MLsys2026 Best Paper]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.