Llama 3.2 3B
on AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
Summary
User reports Llama 3.2 3B at 28 t/s generation and 730 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with Vulkan on the Radeon 8060S iGPU, BF16 quant, 6 threads and maximum GPU offload, run with llama-bench -p 512 -n 128.
The 28 t/s and 730 t/s are separate synthetic phase tests, not an end-to-end rate; context depth, KV precision and batch settings are unreported.