llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD RX 7900 XT · Strata · 32,768 ctx

Tone: positiveAMD hardware
Oct 16, 2026
Throughput
54.0 t/s gen · 1100.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_XS (GGUF)
System RAM
128 GB
VRAM reported
20 GB

Summary

User reports Qwen3.8-Flash-Next at 54 t/s decode and 1,100 t/s prefill on a single AMD RX 7900 XT with 20GB VRAM plus 96GB system RAM. Setup is Strata with Huihui UD-IQ4_XS quant (2/3 experts IQ3_S, rest Q8+) and KV streaming for the full 262k context window, using auto:32768 context on ROCm 10.1. User is happy with the result but asks for advice on speeding up prefill further.