llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3090 · Strata · 131,072 ctx

Tone: positiveNVIDIA hardware
Nov 1, 2026
Throughput
94.2 t/s gen
Quant
Q8_0 (GGUF)
KV cache
int8

Summary

User reports Qwen3.8-Flash-Next Q8_0 at 94.2 t/s single-stream on 2x RTX 3090, with 456 t/s summed across 8 concurrent streams. Setup is Strata with an int8 KV cache, 131072 context, speculative decoding on, and the 188.2 GB GGUF streamed from 504 GB of system RAM on an AMD EPYC 7642 box. The summed 8-stream figure is the arithmetic total of per-stream rates; the measured wall-clock aggregate stays at 56.89 t/s because streams overlap only partially. The same box ran QFN IQ3_S at 121.94 t/s single-stream and 714 t/s summed at C=6, GLM-5.3-Flash at 35.51 t/s and DeepSeek-V4.1-Flash at 44.86 t/s (XS) and 29.87 t/s (S).

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Models most run on the NVIDIA RTX 3090

Bars are medians on one scale, 0 to 111.7 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the NVIDIA RTX 3090 →Every Qwen3.8 report →Estimate Qwen3.8 on this card →