DeepSeek V4 Flash 284B (13B active)
on 2× NVIDIA DGX Spark · vLLM
Sep 30, 2026
Summary
User reports DeepSeek V4 Flash at 72.4 tok/s on two NVIDIA DGX Spark nodes.
Setup is vLLM with fp8_ds_mla KV cache, tensor parallel across both nodes over 200 GbE, prefix cache disabled, DSpark speculative drafting.
Also measured Qwen3.8-Flash-Next NVFP4 on SGLang with NEXTN speculation at 42.6 tok/s and GLM-5.3-Flash on SGLang with DFlash2 speculation at 41.1 tok/s.