DeepSeek V4 Flash 284B (13B active)
on NVIDIA RTX 4090 · llama.cpp · 64,000 ctx
Aug 28, 2026
Use cases
agentic
Summary
User reports DeepSeek V4 Flash at 10.9 t/s generation and 132.5 t/s prompt on an RTX 4090 with 128 GB of DDR5 5600 MT/s.
Setup is llama.cpp llama-server with unsloth's UD-Q2_K_XL quant, 64000 context, flash attention off and 8 threads pinned to the P-cores of an Intel Core Ultra 7 270k, on a 24GB GPU plus system RAM.
Pinning the P-cores took generation from 6.8 tok/s to 11 tok/s, and the IQ4_NL quant ran at 50.7 t/s prompt and 8.1 t/s generation with only about 10k context. The user finds it smarter than Qwen 3.6 27B Q4_K_XL but still prefers Qwen 3.6 27B for agentic work because it runs so much faster.