DeepSeek V4 Flash 284B (13B active)
on 2× NVIDIA RTX 4090 · llama.cpp · 65,536 ctx
Sep 7, 2026
Summary
User reports DSpark draft model performance of 1-2 t/s with DeepSeek-V4-Flash on llama-server, compared to 30-40 t/s with the MTP draft model.
Setup is an RTX 4090 and an RTX 6000 Pro with 120 GB total VRAM and 32 GB RAM, running the unsloth DeepSeek-V4-Flash-0731 137 GB Q4 UD-IQ4-NL quant with the dspark-DeepSeek-V4-Flash-0731-Q8_0.gguf draft model, --spec-type draft-dspark, --spec-draft-n-max 3, --device-draft CUDA1, --tensor-split 2,3, --n-cpu-moe 13, --main-gpu 1, --split-mode layer, --ctx-size 65536, --flash-attn on, --batch-size 2048 and --ubatch-size 2048.
User asks for advice on the correct setup.