llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD RX 7800 XT 16GB · Strata · 41,709 ctx

Tone: mixedAMD hardware
Oct 12, 2026
Throughput
64.9 t/s gen · 985.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_XXS (GGUF)
KV cache
int8
System RAM
64 GB
VRAM reported
16 GB

Use cases

coding

Summary

User reports Qwen3.8-Flash-Next at 64.9 tok/s aggregate decode and 985.8 tok/s prefill on an RX 7800 XT 16GB. Setup is Strata 0.1.42 with IQ3_XXS and int8 KV cache, 39.97 GiB of expert weights in host RAM and 5,048 experts (8.19 GiB) cached in VRAM. MTP was enabled with --spec 4. The 64.9 tok/s is aggregate decode over 54 requests; median per-request was 66.4 tok/s with a 56.1-82.8 tok/s range. Other fresh-prompt prefill readings were 912.9 tok/s at 6,731 tokens, 1,004.6 tok/s at 76,599 tokens, 791.0 tok/s at 116,392 tokens and 509.8 tok/s at 38,790 tokens. Across all 61 tail-skip requests aggregate decode was 52.7 tok/s. An informal comparison gave 50.8 tok/s without route tail skip and 56.7 tok/s with it.