Magistral Small-2509 / Vulkan RADV native PP512/TG128
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Magistral-Small-2509 at 15 t/s generation and 389 t/s prompt processing on an AMD Strix Halo 128GB system with a Radeon 8060S iGPU.
Setup is llama.cpp via RADV with UD-Q4_K_XL, full offload, batch 2048 and flash attention.
The figures are separate llama-bench pp512 and tg128 microbenchmarks, not one end-to-end request; AMDVLK gave 94 t/s prompt processing at the same 15 t/s generation.