llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3090 · Strata · 256,000 ctx

Tone: mixedNVIDIA hardware
Nov 18, 2026
Throughput
38.0 t/s gen
Quant
Q4 (GGUF)
System RAM
64 GB
VRAM reported
24 GB

Use cases

long-contextagentic

Summary

User reports Qwen3.8 Flash-Next at around 38 t/s in Q4 and 50 t/s in Q3 on an RTX 3090 with 64GB of system RAM. Setup is Strata at 256k context with max thinking settings, run for legal research. User asks why a 20-page document analysis takes at least 3 hours with 4 sub agents, and says Strata keeps using sub agents even when they are turned off by prompt. Lowering thinking to high/medium still takes at least 2 hours.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Models most run on the NVIDIA RTX 3090

Bars are medians on one scale, 0 to 111.7 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the NVIDIA RTX 3090 →Every Qwen3.8 report →Estimate Qwen3.8 on this card →