Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX Pro 6000 Blackwell · vLLM · 173,400 ctx
Sep 7, 2026
Use cases
codingtool-usevisionagentic
Summary
User reports Qwen3.8-Flash-Next at roughly 110 t/s, ranging from 76 to 125 t/s, on a single RTX Pro 6000 Blackwell with 96 GB, at 165,000 to 170,000 tokens of context.
Setup is vLLM with the NVFP4 quant and INT4 quantized PLE n-grams, MTP speculative decoding, prefix caching, and PLE CPU offload.
The user praises quality for coding and agentic tasks.