llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 133,760 ctx

AMD hardware
Oct 9, 2026
Throughput
25.9 t/s gen · 1700.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 1700.52 t/s prompt processing and 25.95 t/s generation on an AMD Strix Halo 128GB. Setup is Gufo with an Unsloth UD-Q4_K_XL GGUF, single-user autoregressive with no speculative decoding, greedy sampling, thinking off, at cached depth zero (prompt_n 2040, predicted_n 128). This is an engine-maintainer measurement, not an independent reproduction, and the measured binary was built from a dirty source tree. Allocated context capacity is 133760 tokens, not prompt length. MTP, aggregate concurrency and cached-depth rows are separate workloads.