llamaperf

DeepSeek V4 Flash 284B (13B active)

on 2× NVIDIA RTX 4090 · llama.cpp · 65,536 ctx

Tone: negativeNVIDIA hardware
Sep 7, 2026
Throughput
1-2 t/s gen
Quant
UD-IQ4_NL
System RAM
32 GB
VRAM reported
120 GB

Summary

User reports DSpark draft model performance of 1-2 t/s with DeepSeek-V4-Flash on llama-server, compared to 30-40 t/s with the MTP draft model. Setup is an RTX 4090 and an RTX 6000 Pro with 120 GB total VRAM and 32 GB RAM, running the unsloth DeepSeek-V4-Flash-0731 137 GB Q4 UD-IQ4-NL quant with the dspark-DeepSeek-V4-Flash-0731-Q8_0.gguf draft model, --spec-type draft-dspark, --spec-draft-n-max 3, --device-draft CUDA1, --tensor-split 2,3, --n-cpu-moe 13, --main-gpu 1, --split-mode layer, --ctx-size 65536, --flash-attn on, --batch-size 2048 and --ubatch-size 2048. User asks for advice on the correct setup.