llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD RX 9070 XT 16GB · Strata · 292,000 ctx

Tone: positiveAMD hardware
Oct 18, 2026
Throughput
40.0 t/s gen
Quant
UD-IQ4_XS (GGUF)
KV cache
INT8
System RAM
64 GB
VRAM reported
16 GB

Use cases

agenticlong-context

Summary

User reports Qwen3.8-Flash-Next at around 40 tokens/s on a single RX 9070 XT 16 GB, with experts partly held in 64 GB of system RAM and read from NVMe when not cached. Setup is Strata 0.1.44.1 with Unsloth UD-IQ4_XS weights, INT8 KV cache and a 292,000-token context using YaRN; the RAM expert budget is 48 GiB and the engine memory limit 57 GiB. Prompt processing is about 5,364 tokens/s but may reuse cached context, so it is not a cold-prefill figure. Thinking runs about 36.5 tokens/s and some runs reached about 51 tokens/s. A 49 GiB expert budget was OOM-killed on a roughly 161,000-token conversation.