Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090 · Strata · 128,000 ctx

Oct 2, 2026

Throughput

150-200 t/s gen · 5000-6000 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

IQ3_S (GGUF)

KV cache

8-bit

System RAM

96 GB

Summary

User reports Qwen3.8-Flash-Next at IQ3_S running on a power limited RTX 5090 with 96GB of DDR5-6400, giving 150-200 tok/s decode and 5-6k prefill. Setup is Strata with IQ3_S weights and 8-bit KV cache at 128k tokens of context. Both figures are given as ranges, so no single throughput is recorded.

View source ↗