Global

llamafile lets you distribute and run LLMs with a single file.

3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.

Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Your AI second brain. Self-hostable. Get answers from the web or your docs.

Our managed platform runs a version of our latest open source model, Chandra — higher accuracy than Marker, with zero data retention by default, SOC 2 Type 2, and custom BAAs.

A low-latency, fully modular voice-agent pipeline: VAD -> STT -> LLM -> TTS, exposed through the core OpenAI Realtime GA event set over WebSocket and WebRTC. Every component is swappable. cpp server on your own hardware for a fully local, fully open stack.

Run Bonsai 2 27B locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU.

We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA.

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

txt API is currently in early access. Request access here →

The Open Source Strix Halo AI engine. 56tg tok/s single user with DFlash2

7B, two compact, general-purpose language models designed to make capable AI more practical, efficient, and accessible.

Hy-MT2 is a family of “fast-thinking” multilingual translation models designed for complex real-world scenarios. 8B, 7B, and 30B-A3B (MoE), all of which support translation among 33 languages and effectively follow translation instructions in multiple languages. 5x.

Self-hosted, local-first orchestration for tool-using AI agents. Give LLMs real tools — shell, files, search, web — and run them across your own cluster with direct HTTP routing and interactive interfaces.

An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

An open-source RAG-based tool for chatting with your documents.

Agentlas Hub is a free agent community. Publishing and calling public agents requires no agent price, lease, or Agentlas credit purchase. The caller supplies their own model and API access; subscription plans cover Agentlas software and hosted features.

Our managed platform runs both Surya, and variants of our highest accuracy model, Chandra.

Eight SDKs, one C++ core. A capability registry routes every call to the best engine on the device, and the Console manages your fleet from above.

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Companies like OpenAI built "Super AI" that threatens human independence. We crave individuality: AI that amplifies, not erases, YOU.

Unified framework for building enterprise RAG pipelines with small, specialized models

Simple Python bindings for @ggerganov's llama.cpp library. This package provides:

Query and summarize your documents or just chat with local private GPT LLMs using h2oGPT, an Apache V2 open-source project.

Currently, LlamaGPT supports the following models. Support for running custom models is on the roadmap.

> 🚀 TurboQuant KV cache compression is now in vLLM (PR #38479, merged April 2026): --kv-cache-dtype turboquantk8v4 and friends, with fused Triton store/decode kernels. The PR discussion drew on the asymmetric K/V findings from this repo.