PS5LM README

项目的 README,来自 github.com/cobanov/PS5LM。合并为一个 markdown 文件:README.md。

PS5LM

PS5LM

Your PS5 runs the language model. Every device on your network uses it.
llama.cpp on the console's GPU, with OpenAI and Anthropic APIs and a screen made for the TV.

Get the app · Website · Get started · Issues

New: decision models, powered by Ollaya. PS5LM now runs Jev-like decision models (d1, Clef, OpenJev and more) on the GPU and answers the same /v1/systemone API as Ollaya: typed decisions with calibrated probabilities, in a fraction of a second.

PS5LM is for anyone with a jailbroken PS5 who wants a private model server at home. It loads a GGUF model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs no PC while it runs, no cloud and no account.

Qwen 3.5 9B generating on a PS5, with the requests streaming across the TV
Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video.

Home: the model, its speed and the live requests Models: the ones suggested for the PS5 Home with a decision model Console: temperature, power and load over time API: the endpoints and an example Settings: a list of choices under the row
Home, Models, Console, API and Settings on the TV.

A model server under your TV

Model Size On a PS5 Slim
Qwen 3.5 0.8B, Q4_K_M 0.5 GB 207 tokens a second
Qwen 3.5 9B, Q4_K_M 5.3 GB 55 tokens a second
Qwen 3.8 27B, UD-Q2_K_XL 9.2 GB about 20 tokens a second, 64k context
d1 Omni 600M, a decision model 1.1 GB 3 questions in 0.3 s; a 720p image and 7 questions in 2.9 s

Ternary Bonsai 2

PrismML's Bonsai 2 27B is Qwen 3.8 27B in ternary weights, 7.1 GB as Q2_0, which leaves a 64k context plenty of room. Its Q2_0 file is in Models > Suggested, and the app's llama.cpp applies the model's Hadamard rotation itself. PrismML's main repository ships PQ2_0 instead, a type only their fork reads; convert it on a PC, losslessly (the result is byte for byte PrismML's own Q2_0):

python3 scripts/bonsai-pq2-to-q2.py Ternary-Bonsai-2-27B-PQ2_0.gguf   # writes Ternary-Bonsai-2-27B-Q2_0.gguf

Decision models, powered by Ollaya

Ollaya runs open decision models on a PC the way Ollama runs language models. PS5LM brings the same idea to the console: a decision model reads a state and answers typed questions in one forward pass, with no text generated.

curl http://<console>:8081/v1/systemone -H 'Content-Type: application/json' -d '{
  "state": "I was charged twice this month. Refund me or I cancel.",
  "questions": {
    "intent": {"type": "choice", "instructions": "What does the customer want?",
               "criteria": {"refund": null, "information": null, "cancel": null}},
    "angry":  {"type": "noul", "instructions": "Is the customer angry?"}
  }
}'

The Suggested list has d1 Omni 600M, d1 3B and Clef Flash. Any GGUF that carries llama.cpp's decision metadata loads the same way, and the app labels it a decision model.

Try it

You need a PS5 on firmware 7.00 to 13.60 (also reported working on 5.50, #37; older firmware is untested), jailbroken, with these payloads loaded:

Payload For
kstuff-lite the kernel patches homebrew runs on required
etaHEN homebrew support required
ShadowMountPlus puts PS5LM on the home screen from /data/homebrew required
elfldr (port 9021) temperature, power and real free space, through ps5-exporter; full-speed downloads, through the app's own ftpsrv recommended
ftpsrv (port 2121) installing the app, copying models from a PC; downloads write through it when it runs recommended
  1. Download ps5lm-app-vX.Y.Z.zip from the latest release and unzip it.
  2. Copy the PPSA99575 folder to /data/homebrew over FTP. ShadowMountPlus adds PS5LM to the home screen.
  3. Open PS5LM, go to Models > Suggested and get a model. Or copy a .gguf to /data/PS5LM/models, or to PS5LM/models on a USB drive.
  4. Load it. Once Home says Ready, open http://<console>:8081 in a browser, or point your OpenAI or Anthropic client at it.

To update, copy the new folder over the old one. Settings, models and downloads stay in /data/PS5LM.

If PS5LM cannot write to /data/PS5LM ("Cannot write to /data/PS5LM/models"), the HEN has not opened the console's storage to it:

If the HEN has not opened the console's storage (/data) to PS5LM, the app says so on its first start and offers its own storage instead: up to 16 GB in /download0/PS5LM, for its settings, logs and models (a download that does not fit is refused before it starts). Models saved in the app's storage stay in the library. Settings > Sound and storage shows which one is in use.

When something goes wrong, Settings > Debug report writes /data/PS5LM/debug-report.txt (and a copy to a USB drive, when one is in): the app's version, the system software, storage, models, settings, the end of both logs and which payload ports answer, with API keys and tokens taken out. Attach it to your issue. The kernel log goes in only if you switch it on there.

Using it from coding tools (opencode, Codex, Claude Code) is in docs/CLI.md.

Where Button Does
Everywhere L1 / R1 Home, Models, API, Console, Settings
Home Cross change the model
Home Square / Triangle send a demo request / type a message
Models D-pad, Cross choose a section and a model; load, unload or download it
Models, Search L2 / R2, Square change the search; check whether a file fits
Models, Downloads Cross, Square pause or resume; cancel (press twice) or clear
Console L2 / R2 the last two minutes / the last hour
Settings D-pad, Cross choose a category and a row; flip it, or pick from its list
Settings, Diagnostics Square, Triangle app or server log; errors only
Settings, Debug report Cross write one file to attach to an issue

Looking inside the model

This fork adds an opt-in endpoint that returns the numbers the model computed. POST /v1/introspect answers with the whole logit row at the positions you name, the probabilities and the entropy, with one row of a named graph tensor for a named layer, and it can also change one channel in place before the rest of the model reads it.

The endpoint is off by default. Turn it on in Settings > Developer > Logits and activations API.

python3 scripts/ps5lm-introspect.py --host <console> --prompt "Once upon a time" \
    --positions last --top-k 10 --tensors l_out --layers 12

Introspection records the request fields, the tensor names, and the cost of each option.

Want to tinker?

C++ on ps5-homebrew-ui, llama.cpp with ggml-vulkan on PS5_Vulkan's RADV, built on Linux.

Building · Console notes · Porting · Research · Models that fit · Roadmap · Changelog · The original payload

Built around it

Experimental multi-console fleet

Fleet splits one GGUF across several consoles over llama.cpp's RPC, controlled by one PC: one model across their memory, not a copy on each, so a model too large for one PS5 can run on two or more. Qwen 3.5/3.6/3.8, Llama, Gemma and gpt-oss all split, and the PC can add its CPU or GPU as another worker. python3 -m fleet control (a page) and python3 -m fleet ctl (JSON, for scripts and agents) run many consoles and GPUs as pools of replicas behind one OpenAI-style API. A replica is a split, a console serving a model by itself, or a GPU. They find consoles on the network and move them in and out of worker mode. A 27B model has run with a 128k context over one PS5 and an RTX 3080. The worker is part of the app and starts only when /data/PS5LM/fleet-worker.txt asks for it (v0.10.0 had it in a separate ps5lm-app-fleet zip). Two-worker CPU inference is tested in CI, and a PS5 worker has served a model together with a PC's CPU, a Mac's GPU and an RTX 3090 (CUDA and Vulkan). It is still experimental: RPC has no authentication, so it belongs on an isolated network you trust. See validation and limits.

Thanks


GPL-3.0-or-later, see LICENSE. llama.cpp keeps its MIT licence, Manrope its OFL. No Sony SDK files, keys, firmware or model weights are in this repository.

PS5LM is not affiliated with Sony Interactive Entertainment. "PlayStation" and "PS5" are trademarks of Sony Interactive Entertainment.

PS5LM (cobanov/PS5LM)

正在搜索数据库…

855 ·GitHub
这是什么?PS5LM 可以把越狱后的 PlayStation 5 变成一台私有的 LLM 服务器:它用 llama.cpp 把 GGUF 模型加载到主机的 GPU 上,并通过兼容 OpenAI 和 Anthropic 的 API 提供服务,供家庭网络中的任何设备使用,同时还能在电视上使用聊天界面。
这是我要装在 PS5 上的应用,还是要在电脑上运行的程序?这是一款直接运行在越狱 PS5 本机上的自制应用。电脑、手机或编程工具只需通过网络连接它即可,运行期间无需电脑参与。
我该如何在 PS5 上运行它?从最新版本中下载 ps5lm-app 压缩包,通过 FTP 将 PPSA99575 文件夹复制到 /data/homebrew,然后在主机上打开 PS5LM,把 .gguf 模型下载或复制到 Models 中,再进行加载。
运行前主机上需要准备什么?需要一台越狱且固件版本为 7.00 至 13.60 的 PS5,并加载必需的 payload:kstuff-lite、etaHEN 和 ShadowMountPlus;另外推荐加装 elfldr 和 ftpsrv,以便查看统计信息和安装应用。
在主机 GPU 上运行大模型有什么需要注意的吗?模型及其上下文可用的共享内存只有 11.4 GB,因此较大的模型运行明显更慢:27B 模型在 64k 上下文下每秒仅约生成 20 个 token,而极小的 0.8B 模型则可达每秒 207 个 token。
我的数据会传到主机之外吗?不会:所有运算都在 PS5 自身的 GPU 上本地完成,无需云服务,使用时也无需账号。
它真的会用到 PS5 的 GPU,还是只用 CPU?它在主机的 RDNA 2 GPU 上运行 llama.cpp 的 Vulkan 后端,并为推理分配专用的共享内存。
Ollaya 是什么?“决策模型”又是什么?Ollaya 是一款用于 PC 的工具,它以 Ollama 运行语言模型的方式运行开放的决策模型。PS5LM 把同样的理念带到了主机上:像 d1 Omni 或 Clef Flash 这样的决策模型,通过 /v1/systemone API 以单次前向计算回答是/否题或打分题,而不是生成文本。
我能让 Claude Code 或其他编程代理连接它吗?可以。PS5LM 提供了 Anthropic 的 /v1/messages 端点,因此 Claude Code 可以直接连接它;docs/CLI.md 中记载了如何从 opencode、Codex 和 Claude Code 使用它。
加载的模型能理解图片吗?如果加载的是带图像投影器的模型,例如 Gemma 4、MiniCPM-V 或 d1,它就能在聊天中以及回答决策问题时处理图片。
它如何决定模型能使用多大的上下文?内置的规划器会读取每个 GGUF 文件,并自动为其分配当前空闲 GPU 显存所能容纳的最长上下文和最佳缓存大小。
作者
cobanov
大小
19.2 MB
星标
855
时长
1个月
提交 · 90 天