Llama 4 Scout 17B-16E / Q4_K_XL / Vulkan native PP512 TG128 / runtime build unknown
AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
- generation:
- 20.2 tokens/s
- prompt processing (prefill):
- 225.0 tokens/s
- quant:
- Q4_K_XL
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.
User reports Llama 4 Scout 17B-16E at 20.2 t/s generation and 225 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is llama.cpp Vulkan on the Radeon 8060S iGPU with Q4_K_XL, 6 threads and maximum GPU offload. The figures come from separate llama-bench phase tests, a 512-token prompt and 128-token generation, not an end-to-end rate; rates are rounded and context depth, KV precision and batch settings are unreported.