llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 16,384 ctx

AMD hardware
Nov 9, 2026
Throughput
34.1 t/s gen · 1888.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User compares Gufo against stock llama.cpp on a 128GB Strix Halo (Ryzen AI Max+ 395) running the full UD-Q4_K_XL Qwen3.8-Flash-Next, with FCLK locked at 2000 MHz. Gufo was run with its internal bench and GUFO_PREFILL_TILE=16384; figures are after warm up, three runs. Gufo reached 1888 t/s on a 16K prefill, 35.0 t/s decode at short context and 34.1 t/s decode at 16K context.