Gemma 4-26B-A4B / Vulkan RADV native benchmark
on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown
Summary
User reports Gemma-4-26B-A4B at 52.9 t/s generation and 1196 t/s prompt processing on a single Radeon 8060S gfx1151 in an AMD Ryzen AI MAX+ 395 with 128 GB unified memory.
Setup is llama-bench with UD-Q4_K_XL, full GPU offload at ngl 999, batch 2048, 32 threads and flash attention 1.
The rates come from separate pp512 and tg128 phases, not simultaneous 512-in/128-out throughput; the 16 GiB artifact is distinct from the Q8_0 25 GiB table.