DeepSeek V4 Flash 284B 0731
on 2× NVIDIA RTX PRO 5000 Blackwell (one 72GB card and one 48GB card) · llama.cpp
Summary
User reports DeepSeek V4 Flash 0731 at 19.4 t/s generation and 52.2 t/s prompt processing on one RTX PRO 5000 Blackwell 72 GB plus one RTX PRO 5000 Blackwell 48 GB.
Setup is llama.cpp CUDA b11063 with MXFP4, f16 K/V cache, flash attention, layer split 4.5/2 and -ncmoe 11, leaving about 110.6 GiB of weights on the GPUs.
The 52.2 t/s is the PP512 cell and the 19.4 t/s is the separate TG128 cell, one repetition each; the 145.63 GiB GGUF exceeds the 118.39 GiB combined VRAM.