llamaperf

DeepSeek V4 Flash 285B (13B active) Vision-Exp

on 2× NVIDIA DGX Spark · vLLM · 1,048,576 ctx

Tone: positiveNVIDIA hardware
Oct 8, 2026
Throughput
80.1 t/s gen
Quant
NVFP4 (NVFP4)
KV cache
NVFP4

Use cases

visioncodingagenticlong-context

Summary

User reports DeepSeek-V4-Flash-Vision-Exp at 80.1 tok/s on count-to-100, 51.8 tok/s on code and 33.2 tok/s on prose, on 2x DGX Spark at TP2. Setup is vLLM with NVFP4 weights and nvfp4_ds_mla KV cache, 1M context, DSpark speculative decoding at k=5, KV pool 2.79M tokens / 19.12 GiB at gpu_memory_utilization 0.85. Without the Patch 4 shared-expert fix the same workloads measure 50.7, 47.2 and 30.4 tok/s. The 0731 text checkpoint reaches 78.4 tok/s peak at 98.9% acceptance with Patch 4, versus 66.1 peak and 60.2% acceptance without. The user notes a ~30% cold-start penalty and that realistic mixed agent traffic at concurrency 4 gives ~88.6 tok/s aggregate and ~22.3 tok/s per stream.