PS5LM README

The project's README from github.com/cobanov/PS5LM. As one markdown file: README.md.

PS5LM

PS5LM

Your PS5 runs the language model. Every device on your network uses it.
llama.cpp on the console's GPU, with OpenAI and Anthropic APIs and a screen made for the TV.

Get the app · Website · Get started · Issues

New: decision models, powered by Ollaya. PS5LM now runs Jev-like decision models (d1, Clef, OpenJev and more) on the GPU and answers the same /v1/systemone API as Ollaya: typed decisions with calibrated probabilities, in a fraction of a second.

PS5LM is for anyone with a jailbroken PS5 who wants a private model server at home. It loads a GGUF model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs no PC while it runs, no cloud and no account.

Qwen 3.5 9B generating on a PS5, with the requests streaming across the TV
Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video.

Home: the model, its speed and the live requests Models: the ones suggested for the PS5 Home with a decision model Console: temperature, power and load over time API: the endpoints and an example Settings: a list of choices under the row
Home, Models, Console, API and Settings on the TV.

A model server under your TV

Model Size On a PS5 Slim
Qwen 3.5 0.8B, Q4_K_M 0.5 GB 207 tokens a second
Qwen 3.5 9B, Q4_K_M 5.3 GB 55 tokens a second
Qwen 3.8 27B, UD-Q2_K_XL 9.2 GB about 20 tokens a second, 64k context
d1 Omni 600M, a decision model 1.1 GB 3 questions in 0.3 s; a 720p image and 7 questions in 2.9 s

Decision models, powered by Ollaya

Ollaya runs open decision models on a PC the way Ollama runs language models. PS5LM brings the same idea to the console: a decision model reads a state and answers typed questions in one forward pass, with no text generated.

curl http://<console>:8081/v1/systemone -H 'Content-Type: application/json' -d '{
  "state": "I was charged twice this month. Refund me or I cancel.",
  "questions": {
    "intent": {"type": "choice", "instructions": "What does the customer want?",
               "criteria": {"refund": null, "information": null, "cancel": null}},
    "angry":  {"type": "noul", "instructions": "Is the customer angry?"}
  }
}'

The Suggested list has d1 Omni 600M, d1 3B and Clef Flash. Any GGUF that carries llama.cpp's decision metadata loads the same way, and the app labels it a decision model.

Try it

You need a PS5 on firmware 7.00 to 13.60, jailbroken, with these payloads loaded:

Payload For
kstuff-lite the kernel patches homebrew runs on required
etaHEN homebrew support required
ShadowMountPlus puts PS5LM on the home screen from /data/homebrew required
elfldr (port 9021) temperature, power and real free space, through ps5-exporter recommended
ftpsrv (port 2121) installing the app, copying models from a PC recommended
  1. Download ps5lm-app-vX.Y.Z.zip from the latest release and unzip it.
  2. Copy the PPSA99575 folder to /data/homebrew over FTP. ShadowMountPlus adds PS5LM to the home screen.
  3. Open PS5LM, go to Models > Suggested and get a model. Or copy a .gguf to /data/PS5LM/models, or to PS5LM/models on a USB drive.
  4. Load it. Once Home says Ready, open http://<console>:8081 in a browser, or point your OpenAI or Anthropic client at it.

To update, copy the new folder over the old one. Settings, models and downloads stay in /data/PS5LM. Using it from coding tools (opencode, Codex, Claude Code) is in docs/CLI.md.

Where Button Does
Everywhere L1 / R1 Home, Models, API, Console, Settings
Home Cross change the model
Home Square / Triangle send a demo request / type a message
Models D-pad, Cross choose a section and a model; load, unload or download it
Models, Search L2 / R2, Square change the search; check whether a file fits
Models, Downloads Cross, Square pause or resume; cancel (press twice) or clear
Console L2 / R2 the last two minutes / the last hour
Settings D-pad, Cross choose a category and a row; flip it, or pick from its list
Settings, Diagnostics Square, Triangle app or server log; errors only

Want to tinker?

C++ on ps5-homebrew-ui, llama.cpp with ggml-vulkan on PS5_Vulkan's RADV, built on Linux.

Building · Console notes · Porting · Research · Models that fit · Roadmap · Changelog · The original payload

Thanks

GPL-3.0-or-later, see LICENSE. llama.cpp keeps its MIT licence, Manrope its OFL. No Sony SDK files, keys, firmware or model weights are in this repository.

PS5LM is not affiliated with Sony Interactive Entertainment. "PlayStation" and "PS5" are trademarks of Sony Interactive Entertainment.

PS5LM (cobanov/PS5LM)

llama-cpp
Searching Database…

542 ·GitHub
PS5LM
What is this?PS5LM turns a jailbroken PlayStation 5 into a private LLM server: it loads a GGUF model onto the console's GPU with llama.cpp and serves it to any device on your home network through OpenAI- and Anthropic-compatible APIs, plus a chat UI on the TV.
Is this an app I install on the PS5, or something I run on my PC?It is a homebrew app that runs directly on the jailbroken PS5 itself; your PC, phone or coding tools just connect to it over the network, and no PC is needed while it runs.
How do I get it running on my PS5?Download the ps5lm-app zip from the latest release, copy the PPSA99575 folder to /data/homebrew over FTP, then open PS5LM on the console and download or copy a .gguf model into Models before loading it.
What do I need on the console before this will work?A PS5 on firmware 7.00 to 13.60 that is jailbroken, with kstuff-lite, etaHEN and ShadowMountPlus loaded as required payloads, plus elfldr and ftpsrv recommended for stats and installing.
Any catch with running big models on a console GPU?Only 11.4 GB of shared memory is available for the model and its context, so larger models run noticeably slower; a 27B model manages only about 20 tokens a second at 64k context, versus 207 tokens a second for a tiny 0.8B model.
Does any of my data leave the console?No: everything runs locally on the PS5's own GPU with no cloud service and no account required to use it.
Does it actually use the PS5's GPU or just the CPU?It runs llama.cpp's Vulkan backend on the console's RDNA 2 GPU, giving the model dedicated shared memory for inference.
What is Ollaya and what are 'decision models'?Ollaya is a PC tool that runs open decision models the way Ollama runs language models. PS5LM brings the same idea to the console: a decision model like d1 Omni or Clef Flash answers typed yes/no or scored questions over the /v1/systemone API in a single forward pass instead of generating text.
Can I point Claude Code or other coding agents at it?Yes, PS5LM exposes Anthropic's /v1/messages endpoint so Claude Code works against it directly, and using it from opencode, Codex and Claude Code is documented in docs/CLI.md.
Can the loaded model understand images?If you load a model with an image projector, such as Gemma 4, MiniCPM-V or d1, it can take pictures both in chat and when answering decision questions.
How does it decide how much context a model can use?A built-in planner reads each GGUF file and automatically gives it the longest context and best cache size that fit in the GPU memory that is free.
What are similar projects?Strata, backburner, project-maya, Janus, MoE4All, rizzo-flow, gpt4all, jev
Which topics is it in?ps5, vulkan-api, llamacpp, llama-cpp, gguf, llm-inference, gpu-acceleration, qwen, homebrew, quantization, openai-compatible, local-llm
Creator
cobanov
Size
16.5 MB
Stars
542
Updated
CommitOct 16Releasev0.9.0Oct 16
Age
17d
Commits · 90 Days