8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
Global
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
#362 · +86 · 1d ·GitHub
8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. cpp and MLX.
VoxCPM is a tokenizer-free Text-to-Speech system that directly generates continuous speech representations via an end-to-end diffusion autoregressive architecture, bypassing discrete tokenization to achieve highly natural and expressive synthesis.
pth） - 支持跨不同 GPU 数量恢复（自动调整 step） - 支持 wandb 训练记录连续性（自动恢复同一个 run）
Find out which open-source Large Language Models (LLMs) your hardware can comfortably run. llmfit inspects your CPU, system RAM, GPU(s), VRAM, and accelerator configuration to recommend models across popular quantizations.
llamafile lets you distribute and run LLMs with a single file.
This repository is Operit's Android edition. Operit 2 is a separate second-generation implementation centered on a shared Rust runtime, Flutter clients, and the operit2 CLI/TUI.
MiniCPM-V and MiniCPM-o are multimodal LLM series designed for strong performance and efficient deployment on devices. MiniCPM-V focuses on efficient vision-language understanding across image, video and text inputs.
#1169 · +24 · 1d ·GitHub
Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. Windows pre-build available! A local Wispr Flow alternative.
mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
#1359 · +20 · 1d ·GitHub
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
G0DM0D3 is a fully open-source, privacy-transparent, multi-model chat interface that pushes the limits of the post-training layer — for red teaming, cognition research, and liberated AI interaction. Built for hackers, philosophers, and system tinkerers.
#1974 · +12 · 1d ·GitHub
Note that this project is under active development. \ API and command-line option may change frequently.
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
#2109 · +11 · 1d ·GitHub
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python.
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
#3713 · +4 · 1d ·GitHub
> Independent research project. SemIf was formerly called OpenJev. It is not affiliated with or endorsed by TypeSafe.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
An educational project made to understand how LLM inference works. The full inference path is implemented in one file without external libraries.
#4611 · +2 · 1d ·GitHub
Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning.
open-source agentic AI data assistant for the next generation of AI + Data products.
#6060 · +1 · 1d ·GitHub
A diagnostic performance logging utility for macOS: logs CPU, memory, GPU, network, and battery from the menu bar to help detect and diagnose performance issues. Free, open source, no telemetry.
#6064 · +1 · 1d ·GitHub
Rizzo Flow is an open-source, local-first implementation of the idea behind Jev, TypeSafe's "System One" model: a function call with judgment that takes unstructured state and returns typed decisions with probabilities — a yes/no, a choice among options, a score on a rubric, a…