Llama 3.2 3B
on AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
Summary
User reports Llama 3.2 3B at 93 t/s generation and 1912 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with Vulkan on the Radeon 8060S iGPU, Q4_K_XL quant, 6 threads, and -ngl 999 for maximum GPU offload.
The figures come from llama-bench with -p 512 -n 128, so prompt and generation are separate synthetic phase tests, not an end-to-end rate; rates are rounded and no raw timings, repetition count, or context depth are reported.