Qwen3.8 27B
on PS5 · llama.cpp
Summary
User reports Qwen3.8-27B at Q2 running on a jailbroken PS5 at about 20 t/s decode and 120 t/s prefill.
Setup is llama.cpp-based homebrew (PS5LM) using the console's roughly 11.4GB of usable unified memory out of 16GB, with 448GB/s of memory bandwidth.
User says memory utilization often reaches only 40-60% of the advertised bandwidth and that prefill is the main frustration; a 30B-A3B MoE was too slow to be practical, while tiny ~0.8B models can exceed 200 t/s but loop endlessly.