Mistral Large 2411 123B / Q4_K_M / Vulkan native PP512 TG128 / runtime build unknown
on AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
Summary
User reports Mistral Large 2411 123B at 3 t/s generation and 45 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with Vulkan on the Radeon 8060S iGPU, Q4_K_M quant, 6 threads and maximum GPU offload.
The source gives 2.97 t/s and 45 t/s for the separate PP512 and TG128 phase tests, rounded to 3 t/s and 45 t/s; the two are not an end-to-end rate.