Gemma 4 31B
on AMD Strix Halo 128GB · Gufo
Oct 11, 2026
Summary
User reports Gemma 4 31B at 6.4 t/s generation and 515.7 t/s prompt on an AMD Strix Halo 128GB unified-memory system.
Setup is the Gufo Gemma development fork with UD-Q8_K_XL, one warmed HTTP single-session request, greedy temperature 0/seed 1, thinking off, autoregressive with draft_n=0.
The run used prompt_n 2038, cache_n 0 and predicted_n 128; the rates are engine-stage figures, not prompt/TTFT or whole-request throughput, and come from a single sample.