DeepSeek V4.1 Flash 552B (16B active)
on 4× NVIDIA RTX PRO 6000 Max-Q · vLLM · 131,072 ctx
Summary
User reports DeepSeek-V4.1-Flash at 249.1 tok/s single-stream decode and 17,982 tok/s prefill on four RTX PRO 6000 Max-Q cards.
Setup is vLLM with bfloat16 weights, fp8 KV cache, TP4/DCP1, RAM Engram tables, adaptive DSpark K7 speculation, 4096-token budget, 32 slots and a 131,072 context cap.
C8 aggregate output is 805.5 tok/s and the C1 verifier rate is 98.58 steps/s; the previous Karmic Kraken release measured 230.6 tok/s, 748.3 tok/s, 17,503 tok/s and 89.87 steps/s respectively.