DeepSeek V4 Flash 284B (13B active)

User reports DeepSeek-V4-Flash at ~41 tok/s single-stream and ~350 tok/s aggregate at c=32 on 2x DGX Spark (GB10, 128 GB unified) via vLLM TP=2 over QSFP56 RoCE. Setup is vLLM with official FP8 weights, 1M context profile, shared ~1.1M-token KV pool; prefill ~1785 t/s. Long-context sweep: 8k 40 t/s, 100k 40 t/s, 200k 38 t/s, 500k 32 t/s decode; prefill ~1970 down to ~1380 t/s. Cross-machine: RTX PRO 6000 ds4 46.9 t/s, M2 Ultra 29.7 t/s, single Spark ds4 IQ2_XXS ~14 t/s. llama.cpp GGUF suite up to 67 t/s (35B-A3B), 172B MoE 31 t/s.