llamaperf

Gemma 4 31B

on AMD Ryzen AI Max+ 395 / Radeon 8060S (Minisforum MS-S1; one participating GPU; total installed RAM unreported) · llama.cpp

Oct 13, 2026
Throughput
3.5 t/s gen · 148.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
BF16 (GGUF)
Flash Attention
on
MTP (Multi-Token Prediction)
off

Summary

User reports Gemma 4 31B at 3.5 t/s generation and 148.3 t/s prompt processing on a Minisforum MS-S1 with an AMD Ryzen AI Max+ 395 (Strix Halo) and Radeon 8060S Graphics. Setup is llama.cpp b8640 with BF16 weights, flash attention on, batch and ubatch 2048, and ngl 99 on Vulkan/RADV. The figures are separate synthetic llama-bench tests, not one 2048-in/128-out request; TG128 was 3.46 t/s and was not measured after the largest prompt context.