llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD RX 9060 XT 16GB · Strata · 65,536 ctx

Tone: mixedAMD hardware
Oct 28, 2026
Throughput
45.5 t/s gen · 161.9 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
Q2_0 (GGUF)
KV cache
int8
System RAM
32 GB
VRAM reported
16 GB

Use cases

chat

Summary

User reports Qwen3.8-Flash-Next Q2_0 at 45.5 t/s decode and 161.9 t/s prefill (pp4k) on an RX 9060 XT 16GB with 32GB DDR4, but says prefill is usually under 150 t/s and asks how to fix it. Setup is Strata 0.1.52 (HIP backend, Windows) with a 64K context and int8 KV cache; the 37.6 GB GGUF exceeds the card's VRAM, so weights run partly from system RAM. Strata's tuner ran 501.5 s and confirmed the defaults; two tuning arms were skipped for lack of free memory (25.6 GiB free, 28.4 GiB needed).

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Models most run on the AMD RX 9060 XT 16GB

Bars are medians on one scale, 0 to 33.5 tokens/s. Press ▶ to watch text arrive at a row's speed.

Everything reported on the AMD RX 9060 XT 16GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →