Gemma 4 26B (4B active)
on AMD RX 7900 XTX · llama.cpp
Sep 24, 2026
Summary
User reports Gemma 4 26B-A4B at 142.76 t/s generation and 4331.21 t/s prompt processing on an RX 7900 XTX after a llama.cpp Vulkan int8 coopmat1 matmul patch.
Setup is llama.cpp with the Q4_0 GGUF, Vulkan backend, flash attention enabled, n_ubatch 1024, and all layers offloaded.
Before the patch the same run measured 135.64 t/s generation and 3410.53 t/s prompt processing. At 8192 context the figures are 125.29 t/s generation and 2885.67 t/s prompt processing; at 16384 context they are 120.82 t/s and 2402.13 t/s.