Qwen3.5 27B

on AMD Strix Halo 128GB · llama.cpp b8171 / c17dce4f / Vulkan RADV

Oct 14, 2026

Throughput

10.7 t/s gen · 220.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

UD-Q4_K_XL (GGUF)

System RAM

128 GB

Summary

User reports Qwen3.5 27B at 10.7 t/s generation and 220.4 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is the b8171 Vulkan build with the UD-Q4_K_XL GGUF, 26.90 B parameters and 16.40 GiB, ngl 99, on a Radeon 8060S (RADV GFX1151). The native figures are PP512 220.35 +/- 3.36 t/s and TG128 10.66 +/- 0.01 t/s, separate synthetic phases rather than a same-request pair; batch, threads, context depth and KV types are unreported.