llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× AMD RX 7900 XTX · Strata

Tone: mixedAMD hardware
Oct 17, 2026
Throughput
1300.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q3_K_S (GGUF)
KV cache
Q8
System RAM
64 GB
VRAM reported
24 GB

Use cases

agenticcoding

Summary

User reports Qwen3.8 Flash-Next at around 50-60 t/s decode with 1300 t/s prefill on a dual RX 7900 XTX system. Setup is Strata with a Q3_K_S GGUF and Q8 KV cache, running on the rest of the system while a Qwen3.8 27B Q4_K_XL model with 131k context and Q8 KV sits on the second card behind the chipset at gen3 x4. The 27B gets around 40 t/s decode and 700-800 t/s prefill. An unused flag raises Flash-Next prefill to about 2300 t/s but makes inference unstable, and a layer split keeps decode the same while bringing prefill near 3000 t/s. User is experimenting with pi/hermes agent setups and is not satisfied with how the two models work together.