Qwen3.5 27B
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Qwen3.5-27B at 12.1 t/s generation and 310 t/s prompt processing on an AMD Strix Halo 128GB system with a single Radeon 8060S iGPU.
Setup is llama.cpp with UD-Q4_K_XL, full offload, batch 2048 and flash attention, using the RADV Vulkan backend.
The figures are separate 512-token prompt and 128-token generation microbenchmarks, not one end-to-end request; the AMDVLK backend gave 86.0 t/s prompt and 11.9 t/s generation.