Mistral-8x22b (source label; Mixtral family reference) / Q4_K_M / Vulkan native PP512 TG128 / runtime build unknown
on AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
Summary
User reports Mistral-8x22b at 8.9 t/s generation and 106 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with Vulkan on the Radeon 8060S iGPU, Q4_K_M quant, 6 threads, and maximum GPU offload (-ngl 999).
The source gives 8.92 t/s and 106 t/s for the separate PP512 and TG128 phases, rounded here to 8.9 t/s; the two are not an end-to-end rate.