llamaperf

Gemma 4 31B

on AMD Strix Halo 128GB · Gufo

AMD hardware
Oct 12, 2026
Throughput
6.3 t/s gen · 515.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q8_K_XL (GGUF)
System RAM
128 GB

Summary

User reports Gemma 4 31B It at 6.35 tokens/s generation and 515.74 tokens/s prefill on a Strix Halo 128GB unified-memory system (Ryzen AI MAX+ 395, Radeon 8060S). Setup is the Gufo Gemma development fork (franzmoca/gufo feat/gemma, not stock Gufo 0.12) with UD-Q8_K_XL GGUF weights, one warmed HTTP single-session prose request, greedy temperature 0, thinking off, autoregressive with no speculation. Actual prompt_n 2038, predicted_n 128. Rates are engine-stage figures from the harness (prefill_tokens*1000/prefill_ms, completion_tokens*1000/decode_ms), not prompt/TTFT or whole-request throughput, and were not independently recomputed or reproduced; one sample, no SD. Explicit KV precision and Flash Attention setting unknown.