DeepSeek V4 Flash 284B (13B active)
on 3× NVIDIA RTX 5090 · llama.cpp · 600,000 ctx
Summary
User reports speculative decoding with the draft model dspark-DeepSeek-V4-Flash-0731-Q8_0.gguf, peaking at 153.9 t/s on code, averaging 120 t/s on code and 80 t/s on non-code.
Setup is a 5090 on x8, an RTX PRO 6000 on x8 and an RTX PRO 5000 on x4 over PCIE Gen5, with a tensor split of 22,8,13.
Spec draft n-max is 5 and p-min is 0.6.