The project's README from github.com/magnitudedev/magnitude. As one markdown file: README.md.
The best way to run local models on your machine
Magnitude is an open source inference server for the hardware you already have. It profiles your machine, recommends the right models for it, then downloads, tunes, and runs them. Plug it into Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline, or use the built-in harness.
⭐ Help us reach more developers and grow the Magnitude community. Star this repo!

See what your Mac can run:
npm i -g @magnitudedev/cli
magnitude setup
Setup profiles your hardware, ranks models by speed, accuracy, intelligence, and memory, and connects your harness to the one you pick.
Or let your agent handle it. Send this to Pi, Claude Code, OpenCode, or whatever you use:
Set up local models for me with the Magnitude CLI. Install it with `npm i -g @magnitudedev/cli` (or my package manager), then run `magnitude docs onboarding` and follow the instructions.
Your agent will profile your hardware, walk you through the best local models for it, download the ones you pick, and switch itself over to them.
An open source inference server for the hardware you already have. It profiles your machine, recommends the right models for it, then downloads, tunes, and runs them. Plug it into the agent you already use.
Magnitude profiles your chip, memory, and bandwidth, then estimates fit and tok/s for every model in the catalog. It ranks them by speed, accuracy, intelligence, and memory so you can pick.
There's no fixed minimum. Magnitude profiles your machine and recommends what runs well on it. More memory lets you run larger models.
macOS, Linux, and Windows through WSL. Metal, CUDA, and Vulkan on the GPU side, or CPU only. Magnitude profiles whatever you have and recommends models that fit.
Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline. During setup, your agent connects your harness to the model you pick. Or use Magnitude's built-in harness.
No. It runs in the background, loads models when your agent needs them, and unloads them when idle or memory gets tight. Your agent can install or switch models through the CLI anytime.
Yes. Prompts, files, and models stay on your machine. Once a model is downloaded, no internet connection is needed.
Magnitude is licensed under the Apache License 2.0.