nobodywho README

The project's README from github.com/nobodywho-ooo/nobodywho. As one markdown file: README.md.

Discord Matrix Mastodon Pub.dev Version PyPI Version npm Version Godot Engine Contributor Covenant Docs

NobodyWho

On-device AI for any device.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently.

Features

Under the Hood

flowchart TD
    FL["Flutter"]:::lang
    PY["Python"]:::lang
    GO["Godot"]:::lang
    K["Kotlin"]:::lang
    S["Swift"]:::lang
    RN["React Native"]:::lang

    FRB["flutter_rust_bridge"]:::glue
    P3["PyO3"]:::glue
    GX["gdext"]:::glue
    U["UniFFI"]:::glue

    FL --> FRB
    PY --> P3
    GO --> GX
    K --> U
    S --> U
    RN --> U

    CORE["NobodyWho · Rust<br/>chat · templates · grammars · sampling · context shifting"]:::core

    FRB --> CORE
    P3 --> CORE
    GX --> CORE
    U --> CORE

    CORE --> LCPP["llama.cpp<br/>text · vision · embeddings · reranking"]:::engine
    CORE --> ORT["ONNX Runtime<br/>speech-to-text · text-to-speech · VAD"]:::engine

    LCPP --> HW["Hardware<br/>Vulkan · Metal · CUDA · GPU · CPU"]:::hw
    ORT --> HW

    classDef lang fill:#e8eefc,stroke:#5b7bd5,color:#11204a
    classDef glue fill:#f3f0fb,stroke:#8b7bd5,color:#2a1f4a
    classDef core fill:#eaf6ee,stroke:#4fa46a,color:#0f3b1f
    classDef engine fill:#fdf0e3,stroke:#d58f3b,color:#4a2d0b
    classDef hw fill:#f0eeea,stroke:#a09a90,color:#3a352e

You can test our inference engine on iOS, Android, Vision Pro and Apple Watch.

Platforms

Binding Install Runs on Documentation
Kotlin Maven Central Desktop, Android docs.nobodywho.ooo/kotlin
Swift SPM macOS, iOS, visionOS, watchOS docs.nobodywho.ooo/swift
React Native / Expo npm Desktop, Android, iOS docs.nobodywho.ooo/react-native
Flutter pub.dev Desktop, Android, iOS docs.nobodywho.ooo/flutter
Python PyPI Desktop docs.nobodywho.ooo/python
Godot AssetLib Desktop, Android docs.nobodywho.ooo/godot

Desktop means Linux, macOS and Windows throughout. Three gaps worth knowing before you start:

⭐ Useful to you? Star the repo, it's the easiest way to say thanks.

Requirements

Inference uses the GPU where available and CPU where not. The real constraint is memory.

Desktop

Mobile

Models

Any model in the GGUF format works. Pass a hf:owner/repo:QUANT reference, an HTTPS URL, or a local path anywhere a model path is expected; remote models are downloaded and cached on first use. Pass "auto" to fit one to available memory.

Start with Qwen3 0.6B: at ~330 MB it is small enough for any phone and good enough to tell whether the integration works.

Quick Start

Python 
pip install nobodywho

from nobodywho import Chat

chat = Chat('hf:NobodyWho/Qwen_Qwen3-0.6B-GGUF:Q4_K_M')
response = chat.ask('What is the capital of Denmark?')
print(response.completed()) # The capital of Denmark is Copenhagen.

Python documentation · PyPI

Kotlin 
// Android
implementation("ai.nobodywho:nobodywho-android:<version>")

// Desktop JVM (Linux, macOS, Windows)
implementation("ai.nobodywho:nobodywho:<version>")

Use the version from the Maven Central badge above.

import ai.nobodywho.Chat

val chat = Chat.fromPath(
    modelPath = "hf:NobodyWho/Qwen_Qwen3-0.6B-GGUF:Q4_K_M"
)

val response = chat.ask("What is the capital of Denmark?").completed()
println(response) // The capital of Denmark is Copenhagen.

Kotlin documentation

Swift

Add via Swift Package Manager:

https://github.com/nobodywho-ooo/nobodywho-swift.git

import NobodyWho

let chat = try await Chat.fromPath(
    modelPath: "hf:NobodyWho/Qwen_Qwen3-0.6B-GGUF:Q4_K_M"
)

let response = try await chat.ask("What is the capital of Denmark?").completed()
print(response) // The capital of Denmark is Copenhagen.

Swift documentation · GitHub · starter app

React Native / Expo 
# React Native
npm install react-native-nobodywho

# Expo
npx expo install react-native-nobodywho

import { Chat } from "react-native-nobodywho";

const chat = await Chat.fromPath({
  modelPath: "hf:NobodyWho/Qwen_Qwen3-0.6B-GGUF:Q4_K_M",
});

const msg = await chat.ask("What is the capital of Denmark?").completed();
console.log(msg); // The capital of Denmark is Copenhagen.

RN / Expo documentation · NPM · RN starter app · Expo starter app

Flutter 
flutter pub add nobodywho

import 'package:nobodywho/nobodywho.dart' as nobodywho;

void main() async {
  await nobodywho.NobodyWho.init();

  final chat = await nobodywho.Chat.fromPath(
    modelPath: 'hf:NobodyWho/Qwen_Qwen3-0.6B-GGUF:Q4_K_M',
  );

  final msg = await chat.ask('What is the capital of Denmark?').completed();
  print(msg); // The capital of Denmark is Copenhagen.
}

Flutter documentation · pub.dev · starter app

Godot

Install NobodyWho from inside the editor:

  1. In Godot 4.5+, open the AssetLib tab and search for NobodyWho.
  2. Download and import it, making sure Ignore asset root is ticked in the import dialogue.
  3. Reload the project.

You can also grab a specific version from the releases page and import the zip the same way.

Godot documentation

Local Server

NobodyWho provides an experimental local server that implements the OpenAI Chat Completions API.

Start the server :

uvx --from 'git+https://github.com/nobodywho-ooo/nobodywho.git#subdirectory=nobodywho/server' nobodywho-server --model hf:NobodyWho/Qwen_Qwen3-0.6B-GGUF:Q4_K_M --name qwen

It listens on http://127.0.0.1:8888 and serves /v1/models and /v1/chat/completions. See the docs for more info.

Documentation

The documentation has everything you might want to know: https://docs.nobodywho.ooo/

Working with a coding agent? Point it at llms.txt or llms-full.txt, or install the NobodyWho skill so your agent can look up the current APIs and documentation:

npx skills add https://github.com/nobodywho-ooo/nobodywho --skill nobodywho

Community

⭐ Star the repo if NobodyWho is useful to you. It is how people find us.

License

NobodyWho is licensed under the EUPL-1.2. You may use it in proprietary and commercial projects, free of charge. There has been some confusion about this, so to be precise:

Linking two programs or linking an existing software with your own work does not – at least under European law – produce a derivative or extend the coverage of the linked software licence to your own work. [1]

If you distribute modified versions of the code in this repo, you must open source those changes.

Feel free to make proprietary projects using NobodyWho, but don't make a proprietary fork of NobodyWho.

nobodywho (nobodywho-ooo/nobodywho)

expo
Searching Database…

1.6K ·GitHub
Nobodywho
What is this?NobodyWho is an open-source inference engine that runs LLMs locally and offline on phones, desktops and even Apple Watch — no API keys, no cloud calls. Under the hood it is powered by llama.cpp and accelerates through the GPU via Vulkan or Metal.
Is it a standalone app or something I embed into my own project?You embed it: it ships as bindings for Kotlin, Swift, React Native/Expo, Flutter, Python and Godot, so chat, speech and tool calling live inside your own app or game. Each binding has its own docs under docs.nobodywho.ooo.
How do I add it to my project?Through your stack's normal package manager: PyPI for Python, npm for React Native/Expo, pub.dev for Flutter, Maven Central for Kotlin and Swift Package Manager for Swift. In Godot 4.5+ open the AssetLib tab, search for NobodyWho, import with 'Ignore asset root' ticked and reload the project.
Do I need an API key or a beefy GPU to run it?No keys or accounts — everything runs locally and offline. It uses the GPU when one is available (Metal on macOS, Vulkan on Linux and Windows, with CPU fallback) and its offloading splits layers between VRAM and RAM; the real limit is memory, roughly 1.5x the model file in free RAM.
Where does it not work today?Three known gaps: the Godot binding has no iOS export (use the Flutter, React Native or Swift binding there), Windows ARM64 is not supported — x86_64 only — and there is no web export yet.
Can I ship it inside a proprietary, commercial app?Yes. It is EUPL-1.2 and the README is explicit that linking it does not make your work derivative — proprietary and commercial use is free. The only condition: if you distribute modified versions of NobodyWho itself, those changes must be open-sourced.
What can it do beyond plain chat completions?Plenty: type-safe tool calling that auto-generates structured grammars from your function signatures, multimodal input with images and audio, text-to-speech via Kokoro, Pocket TTS and Supertonic, speech-to-text with Whisper, and voice activity detection with Silero so it knows when you stop talking.
Can I point existing OpenAI-format tools at it?Yes — an experimental local server implements the OpenAI Chat Completions API, serving /v1/models and /v1/chat/completions, so clients already built for OpenAI can talk to your local models.
How do I get my coding agent familiar with its API?Point it at llms.txt or llms-full.txt, or install the NobodyWho skill with 'npx skills add --skill nobodywho' so the agent can look up the current APIs and documentation itself.
Does it really run on Apple Watch and Vision Pro?The Swift binding targets macOS, iOS, visionOS and watchOS, and the README says you can test the engine on iOS, Android, Vision Pro and Apple Watch — bring a small model.
What are similar projects?runanywhere-sdks, supertonic, mlx-serve, uzu, rizzo-flow, meetily, gallery, unsloth
Which topics is it in?godot-engine, stt, godot, expo, on-device-ai, llama-cpp, tool-calling, inference-engine, gguf, metal, flutter, vulkan
Creator
nobodywho-ooo
Size
184.2 MB
Stars
1.6K
Updated
CommitOct 17Releasenobodywho-swift-v5.1.0Oct 09
Age
2y
Commits · 90 Days