llamaperf

DeepSeek V4 Flash 162B (13B active)

on NVIDIA DGX Spark · vLLM · 200,000 ctx

Tone: mixedNVIDIA hardware
Oct 8, 2026
Throughput
13.9 t/s gen · 539.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
NVFP4 (NVFP4)
KV cache
FP8

Use cases

long-contexttool-use

Summary

User reports DeepSeek V4 Flash 162B (REAP K144 pruned) at 13.899 tok/s decode and 538.958 tok/s prefill on a single DGX Spark. Setup is vLLM with NVFP4/MXFP4 expert weights and FP8 KV cache, 200K context, 14 GB KV cache, no speculative decoding. Validation used a 186,390-token prompt with 345.834 s TTFT and needle retained; the watchdog logged a low-memory kill at teardown, so the profile is proof-of-concept. K160 prefills at about 514 tok/s and decodes at about 24 tok/s with MTP.