DeepSeek V4 Flash 162B (13B active)
on NVIDIA DGX Spark · vLLM · 200,000 ctx
Oct 8, 2026
Use cases
long-contexttool-use
Summary
User reports DeepSeek V4 Flash 162B (REAP K144 pruned) at 13.899 tok/s decode and 538.958 tok/s prefill on a single DGX Spark.
Setup is vLLM with NVFP4/MXFP4 expert weights and FP8 KV cache, 200K context, 14 GB KV cache, no speculative decoding.
Validation used a 186,390-token prompt with 345.834 s TTFT and needle retained; the watchdog logged a low-memory kill at teardown, so the profile is proof-of-concept. K160 prefills at about 514 tok/s and decodes at about 24 tok/s with MTP.