llamaperf

Gemma 4 26B (4B active)

on AMD RX 7900 XTX · llama.cpp

Tone: positiveAMD hardware
Sep 24, 2026
Throughput
142.8 t/s gen · 4331.2 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_0 (GGUF)
VRAM reported
24 GB

Summary

User reports Gemma 4 26B-A4B at 142.76 t/s generation and 4331.21 t/s prompt processing on an RX 7900 XTX after a llama.cpp Vulkan int8 coopmat1 matmul patch. Setup is llama.cpp with the Q4_0 GGUF, Vulkan backend, flash attention enabled, n_ubatch 1024, and all layers offloaded. Before the patch the same run measured 135.64 t/s generation and 3410.53 t/s prompt processing. At 8192 context the figures are 125.29 t/s generation and 2885.67 t/s prompt processing; at 16384 context they are 120.82 t/s and 2402.13 t/s.