llamaperf

DeepSeek V4 Flash 284B (13B active)

on 3× NVIDIA RTX 3090 · llama.cpp

NVIDIA hardware
Sep 7, 2026
Throughput
7.7 t/s gen · 116.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q3_K_XL (GGUF)
System RAM
122 GB
VRAM reported
24 GB

Summary

User reports llama-bench results on 3x RTX 3090 with Q3_K_XL quantization. The model is 119.40 GiB with 284.33 B params. Prompt processing runs at 116.04 t/s and generation at 7.71 t/s.