llamaperf
Oct 10, 2026
Throughput
36.9 t/s gen · 1232.9 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4 Mix (Q4_K/Q5_1/IQ4_NL/Q8_0) (GGUF)
MTP (Multi-Token Prediction)
on
System RAM
128 GB

Summary

User reports Qwen3.8 Flash-Next Uncensored at 36.9 t/s generation and 1232.9 t/s prefill on an AMD Strix Halo 128GB. Setup is Gufo with MTP speculative decoding on, Q4 Mix (Q4_K/Q5_1/IQ4_NL/Q8_0), one request. Medians of the three mixed-long requests (10,583-token prompts) in vmlinux's bench-gufo-mtp.json. A source-reported measurement, not independently reproduced.