llamaperf

Gemma 4 31B

on AMD Strix Halo 128GB · Gufo

AMD hardware
Oct 11, 2026
Throughput
12.1 t/s gen · 573.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
QAT UD-Q4_K_XL (Q4_0) (GGUF)
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Gemma 4 31B at 12.1 t/s generation and 573.6 t/s prefill on an AMD Strix Halo 128GB-class unified-memory system. Setup is the Gufo Gemma development fork with QAT UD-Q4_K_XL (Q4_0) weights, one warmed HTTP single-session prose request, greedy temperature 0/seed 1, thinking off, autoregressive with draft_n=0. The row is one sample with no SD, prompt_n 2038, cache_n 0, predicted_n 128; rates are engine-stage, not whole-request throughput, and were not independently recomputed.