Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · Strata
Use cases
agenticcoding
Summary
User reports Qwen3.8-Flash-Next Gyro-M at 170-210 t/s decode and up to 5k t/s prefill on a dual RTX 3090 machine with 128GB DDR4, using Strata with a UD-Q5_K_XL GGUF and F16 KV cache. All experts and KV cache fit in VRAM, with the PLE in system RAM.
On a second machine (dual RTX 5070 Ti, 32GB DDR4) the same model ran at 105-115 t/s decode and up to 3k t/s prefill with int8 KV cache, slower to decode than the IQ3_XXS build it replaced but with higher prefill.
The user says Gyro-M quality is on par with Q4 and nearly as capable as Q5, with no reasoning loops or file rewrites, and has used it as a subagent for a couple of weeks. The previous IQ3_XXS build ran at 120 t/s decode and 2-2.5k t/s prefill on the 5070 Ti pair, and the Q5 build at 85-95 t/s decode and 1.5-2k t/s prefill on the 3090 pair.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Models most run on the NVIDIA RTX 3090
- Qwen3.8 27B4-bit38.4 t/s · 7 runs
- 85.9 t/s · 2 runs
- Gemma 4 31B4-bit36.5 t/s · one run
- Llama 3 8B4-bit111.7 t/s · one run
- Muse 30B4-bit30.0 t/s · one run
- Qwen2.5 32B4-bit28.0 t/s · one run
Bars are medians on one scale, 0 to 111.7 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the NVIDIA RTX 3090 →Every Qwen3.8 report →Estimate Qwen3.8 on this card →