Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA DGX Spark · vLLM · 262,000 ctx
Oct 12, 2026
Use cases
codingtool-uselong-contextagentic
Summary
User reports Qwen3.8-Flash-Next at 86 tok/s single-stream on 2x DGX Spark with TP=2, and 60 tok/s on a single DGX Spark.
Setup is vLLM with NVFP4 experts and MXFP8 dense layers, 262K context, MTP with 4 probabilistic drafts, and a retrained drafter. Aggregate throughput at 8 concurrent requests is 195 tok/s on 2x and 137 tok/s on 1x; with thinking off on 36 coding prompts it is 113 tok/s single-stream and 317 tok/s aggregate on 2x.
User's own requant beats the publisher's vLLM image (51.8 tok/s c1 defaults, 96.6 tok/s c8) by 1.67x to 2.02x. IFEval strict 87.4% vs 87.1% shows no quality loss. Two independent 1x replicas (DP=2) reach 241 tok/s at c16.