llamaperf

Gemma 4 DiffusionGemma-26B-A4B-it

on AMD Ryzen AI Max+ 395 / Radeon 8060S (Strix Halo; 121 GiB unified memory reported) · Gufo · 131,072 ctx

Oct 13, 2026
Throughput
3180.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)

Summary

User reports Gemma 4 at 3180 t/s prompt processing on one AMD Ryzen AI Max+ 395 / Radeon 8060S integrated GPU (Strix Halo). Setup is the Gufo native HIP engine with Q8_0 GGUF and a 131072-token context, one request at a time. The 3180 t/s is native prefill for a 2,261-input-token book prompt producing 512 output tokens, with TTFT 6.0 s and 141 ms per denoising step; prefill falls to 1,339 t/s at 121,294 input tokens.