llamaperf

DeepSeek V4 Flash 284B (13B active)

on 4× NVIDIA RTX 3090 · llama.cpp

Tone: mixedNVIDIA hardware
Oct 3, 2026
Throughput
6.0 t/s gen
System RAM
256 GB
VRAM reported
96 GB

Summary

User asks which inference engine is fastest for a full quant on 96GB of VRAM, with 4x RTX 3090 and 256GB of 8-channel DDR4. They report getting at most 6 t/s on short prompts with llama.cpp CUDA. No model, quant, or context length is named.