Qwen3.5 9B
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Qwen3.5-9B at 35.7 t/s generation and 972 t/s prompt processing on a single Radeon 8060S iGPU in an AMD Strix Halo system with 128 GB unified memory.
Setup is llama.cpp with UD-Q4_K_XL, full offload (ngl 999), batch 2048, 32 threads and flash attention, using the RADV Vulkan backend.
The figures are separate llama-bench pp512 and tg128 microbenchmarks, not one end-to-end request; the AMDVLK backend gave 289.0 t/s prompt and 35.2 t/s generation.