gpt-oss 117B (5.1B active)
on AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
Summary
User reports gpt-oss 120B at 54 t/s generation and 500 t/s prompt processing on an AMD Strix Halo 128GB machine, a Framework Desktop with AMD AI Max 395+ and 128 GB LPDDR5.
Setup is llama.cpp with Vulkan on the Radeon 8060S iGPU, MXFP4 quantization, 6 CPU threads, and maximum GPU offload (-ngl 999).
The figures come from separate llama-bench phase tests, a 512-token prompt and 128-token generation, not an end-to-end rate; rates are rounded and context depth, KV precision, and batch settings are unreported.