Gemma 3 27B
on AMD Strix Halo 128GB · llama.cpp / Vulkan KHR cooperative matrices / build unknown
Summary
User reports Gemma 3 27B at 3.9 t/s generation and 104 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp with Vulkan on the Radeon 8060S iGPU, BF16 weights, 6 threads and maximum GPU offload (-ngl 999).
The figures come from separate synthetic llama-bench phase tests, PP512 and TG128, not an end-to-end rate; the source gives rounded rates without raw durations or repeat counts.