DeepSeek V4 Flash 284B (13B active)
on NVIDIA RTX PRO 6000 Max-Q · DwarfStar 4
Summary
User reports DeepSeek V4 Flash at 43.6 tok/s generation on a short prompt and 262 tok/s prefill on a 20K-token prompt on an RTX PRO 6000 Blackwell Max-Q.
Setup is DwarfStar 4 (ds4.c) with an IQ2_XXS + Q2_K quant, single session, no MTP or speculative decoding.
Generation drops to 31.4 tok/s at 50K context; peak VRAM observed 93,142 MiB of 95,593 MiB (95%).