Devstral Small-2-24B / Vulkan RADV native PP512/TG128
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Devstral-Small-2-24B at 15 t/s generation and 382 t/s prompt processing on an AMD Strix Halo 128GB system with a single Radeon 8060S iGPU.
Setup is llama-bench with UD-Q4_K_XL, full offload, batch 2048 and flash attention; the 120 GB GPU-memory cap is a software limit, not observed usage.
The 382 t/s is native PP512 and the 15 t/s is native TG128, separate microbenchmarks rather than one end-to-end request; repetition count, spread and context allocation are not published.