Qwen3.8 Flash-Next GDN-MSE, 2x v2.0.0, coding C1 median decode
on 2× NVIDIA DGX Spark · vLLM · 262,144 ctx
Oct 11, 2026
Use cases
coding
Summary
User reports Qwen3.8 at 118.6 t/s on two NVIDIA DGX Spark (GB10 Grace Blackwell) machines at TP=2.
Setup is vLLM with NVFP4 experts and MXFP8 dense/attention paths, FP8 KV cache, probabilistic MTP with 4 draft tokens, and a configured max_model_len of 262144.
The figure is the mean of 3 boot-level means of per-pass median request decode rates over 36 coding prompts run one at a time, with a between-boot sample SD of 0.353 t/s; the workload is favorable to MTP and is not a general conversational speed estimate.