Qwen3.5 4B
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Qwen3.5-4B at 37.9 t/s generation and 1375 t/s prompt processing on a single Radeon 8060S iGPU in an AMD Strix Halo system with 128 GB unified memory.
Setup is llama.cpp with Q8_0 and flash attention, full offload, batch 2048 and 32 threads; the source labels the run RADV Vulkan.
These are separate 512-token prompt and 128-token generation microbenchmarks, not one end-to-end request. The same campaign reports AMDVLK at 510.0 t/s prompt and 40.0 t/s generation.