Ministral 3-14B / Vulkan RADV native PP512/TG128
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Ministral-3-14B at 25 t/s generation and 696 t/s prompt processing on an AMD Strix Halo 128GB system with a single Radeon 8060S iGPU.
Setup is llama.cpp with UD-Q4_K_XL, full offload, batch 2048 and flash attention, measured via llama-bench pp512 and tg128.
The 696 t/s is native prompt processing, not TTFT-derived, and the 25 t/s is native generation throughput; the two are separate microbenchmarks, not one end-to-end request.