Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · Strata · 131,072 ctx
Summary
User reports Qwen3.8-Flash-Next Q8_0 at 94.2 t/s single-stream on 2x RTX 3090, with 456 t/s summed across 8 concurrent streams.
Setup is Strata with an int8 KV cache, 131072 context, speculative decoding on, and the 188.2 GB GGUF streamed from 504 GB of system RAM on an AMD EPYC 7642 box.
The summed 8-stream figure is the arithmetic total of per-stream rates; the measured wall-clock aggregate stays at 56.89 t/s because streams overlap only partially. The same box ran QFN IQ3_S at 121.94 t/s single-stream and 714 t/s summed at C=6, GLM-5.3-Flash at 35.51 t/s and DeepSeek-V4.1-Flash at 44.86 t/s (XS) and 29.87 t/s (S).
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Models most run on the NVIDIA RTX 3090
- Qwen3.8 27B4-bit38.4 t/s · 7 runs
- 85.9 t/s · 2 runs
- Gemma 4 31B4-bit36.5 t/s · one run
- Llama 3 8B4-bit111.7 t/s · one run
- Muse 30B4-bit30.0 t/s · one run
- Qwen2.5 32B4-bit28.0 t/s · one run
Bars are medians on one scale, 0 to 111.7 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the NVIDIA RTX 3090 →Every Qwen3.8 report →Estimate Qwen3.8 on this card →