llamaperf
Oct 9, 2026
Throughput
28.4 t/s gen · 314.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User benchmarks Qwen3.8-Flash-Next at 28.4 t/s decode and 314 t/s prefill on a Minisforum S1 Max with AMD Ryzen AI Max+ 395 and 128 GB unified memory. Setup is llama.cpp (Vulkan, Unsloth build) with UD-Q4_K_XL weights and MTP speculative decoding at 56% accept rate. The repo also lists community engine comparisons on the same hardware: gufo 34.1 t/s decode and 1,075 t/s prefill, Halogen 39.4/1,191, strixllama 29.7/716, and llama.cpp ROCm 20.5/285. The GGUF checkpoint uses a shared BF16 PLE of about 95 GiB that should stay NVMe-backed via mmap on 128 GB machines.