DeepSeek V4 Flash 284B (13B active)
on 10× NVIDIA RTX 3090 · KoboldCpp
Use cases
long-contextcodingsummarizationmultilingual
Summary
User reports DeepSeek V4 Flash 294B Q8KXL at 7.2 t/s generation and 111.09 t/s prompt processing on a 10-GPU server (8x RTX 3090 + 2x RTX 5090, 256GB VRAM).
Setup is koboldcpp with llama.cpp under the hood, GGUF weights, all 10 cards allocated with tensor split, clocks locked to 1200 MHz and power limited to 200W per 3090 to prevent transient spikes.
The figures are from the first of seven large cybersecurity prompts (2769 input tokens, 813 output tokens); later prompts in the sweep drop to 4.28 t/s generation and 28.38 t/s prompt processing. The user notes the model was the smallest tested but punched above its weight in quality, and that the speed drop versus other models was an acceptable trade-off.