Qwen3.5 35B (3B active)

on AMD Strix Halo 128GB · llama.cpp b8171 / c17dce4f / Vulkan RADV

Oct 14, 2026

Throughput

53.4 t/s gen · 865.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

UD-Q4_K_XL (GGUF)

System RAM

128 GB

Summary

User reports Qwen3.5 35B-A3B at 53.4 t/s generation and 865.7 t/s prompt processing on an AMD Strix Halo 128GB machine. Setup is llama-bench build b8171 with the Vulkan backend, UD-Q4_K_XL quant, ngl 99, and a Radeon 8060S Graphics (RADV GFX1151) device. The rates are separate synthetic phases: PP512 at 865.72 +/- 59.59 t/s and TG128 at 53.39 +/- 0.08 t/s, not a same-request prompt/output pair.