Qwen3.5 9B

on AMD Strix Halo 128GB · llama.cpp b8171 / c17dce4f / Vulkan RADV

Oct 14, 2026

Throughput

31.1 t/s gen · 819.2 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

UD-Q4_K_XL (GGUF)

System RAM

128 GB

Summary

User reports Qwen3.5 9B at 31.1 t/s generation and 819.2 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is llama-bench build b8171 with the Vulkan backend, UD-Q4_K_XL quant, ngl 99, and a Radeon 8060S (RADV GFX1151) device. The rates are separate synthetic phases: PP512 at 819.24 +/- 55.72 t/s and TG128 at 31.09 +/- 0.05 t/s, not a same-request prompt/output pair.