Mistral Small-4-119B / Vulkan RADV native PP512/TG128
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / b9518
Summary
User reports Mistral-Small-4-119B at 40.3 t/s generation and 363 t/s prompt processing on a single Radeon 8060S iGPU in an AMD Strix Halo system with 128 GB unified memory.
Setup is llama.cpp Vulkan build 9518 with Unsloth UD-Q4_K_XL, full offload, batch 2048 and flash attention.
The figures are separate 512-token prompt and 128-token generation microbenchmarks, not one end-to-end request; the quant is split across three files totalling 69 GiB.