llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 256,000 ctx

AMD hardware
Oct 9, 2026
Throughput
1057.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
MTP (Multi-Token Prediction)
on
System RAM
128 GB

Use cases

long-context

Summary

User reports a third-party sourced prefill measurement of Qwen3.8-Flash-Next at 1057.53 t/s on a single Strix Halo 128GB system. Setup is Gufo with Unsloth UD-Q4_K_XL GGUF weights, a 256000-token prompt with zero cached prefix tokens, 512-token prefill chunks, and MTP enabled with a shared Q8 MTP head and draft ceiling 7. The row is prefill-only and generates one setup token, so no generation throughput is reported. One observation per cell on a synthetic counting workload; no repeats, uncertainty interval, TTFT or row-level memory peak are available.