llamaperf

DeepSeek V4 Flash 284B (13B active)

on NVIDIA RTX 4090 · llama.cpp · 64,000 ctx

Tone: mixedNVIDIA hardware
Aug 28, 2026
Throughput
10.9 t/s gen · 132.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q2_K_XL (GGUF)
System RAM
128 GB
VRAM reported
24 GB

Use cases

agentic

Summary

User reports DeepSeek V4 Flash at 10.9 t/s generation and 132.5 t/s prompt on an RTX 4090 with 128 GB of DDR5 5600 MT/s. Setup is llama.cpp llama-server with unsloth's UD-Q2_K_XL quant, 64000 context, flash attention off and 8 threads pinned to the P-cores of an Intel Core Ultra 7 270k, on a 24GB GPU plus system RAM. Pinning the P-cores took generation from 6.8 tok/s to 11 tok/s, and the IQ4_NL quant ran at 50.7 t/s prompt and 8.1 t/s generation with only about 10k context. The user finds it smarter than Qwen 3.6 27B Q4_K_XL but still prefers Qwen 3.6 27B for agentic work because it runs so much faster.