Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA DGX Spark · vLLM
Summary
User reports 49.7 t/s decode on structured output and 34.8 t/s decode on prose with TP2 across two DGX Sparks, plus prefill of about 2,875 t/s for 11k tokens.
Setup is MTP k=3 in eager mode. MTP acceptance is about 3.8 tokens/step on structured output.
A single node reaches about 35 t/s on structured output.