llamaperf

DeepSeek V4 Flash 284B (13B active)

on NVIDIA RTX 4090 · llama.cpp · 65,536 ctx

Tone: mixedNVIDIA hardware
Sep 7, 2026
Throughput
12-13.1 t/s gen
Quant
UD-Q3_K_M (GGUF)
KV cache
q8_0
System RAM
128 GB
VRAM reported
24 GB

Use cases

agenticcoding

Summary

User reports generation at 12.0-13.1 t/s and prompt processing at 212-224 t/s for 8k-32k tokens. Setup uses --n-cpu-moe 39 to offload experts to CPU, and requires 128 GB RAM. Agentic tasks take 15-26 minutes. No quality benchmarks were run.