llamaperf
Oct 11, 2026
Throughput
81.4 t/s gen · 4131.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
QAT UD-Q4_K_XL (Q4_0) (GGUF)
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Gemma 4 26B-A4B at 81.4 t/s generation and 4131 t/s prompt processing on AMD Strix Halo with 128GB unified memory. Setup is the franzmoca/gufo Gemma fork with native HIP kernels for gfx1151, QAT UD-Q4_K_XL (Q4_0), MTP off. The figures are separate native gufo bench synthetic tests (pp2048 and tg128), not a paired chat request or HTTP end-to-end throughput; the author states three repetitions but not the aggregate statistic.