llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090 · Strata · 262,144 ctx

Tone: positiveNVIDIA hardware
Oct 19, 2026
Throughput
121.4 t/s gen · 2757.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
NVFP4 (NVFP4)
KV cache
int8
System RAM
192 GB
VRAM reported
32 GB

Use cases

codingvision

Summary

User reports Qwen3.8-Flash-Next 125B-A6B running a single-prompt Blender room-building challenge on an RTX 5090 32GB, with engine-verified decode median 121.4 t/s and mean prefill 2,757 t/s. Setup is the strata-nvfp4 fork of Strata with self-converted NVFP4 experts plus Q8_0 dense weights, int8 KV cache, 262,144 max context, MTP draft head with spec 5, and 63 GiB of experts pinned in 192GB DDR5 system RAM. The run took 26m 17s over 103 steps and 132,929 output tokens with 179 tool calls and no compactions, peaking at 194k context; TTFT was 0.85s median and 32.9s max, and the vision encoder ran on CPU.