llamaperf

DeepSeek V4 Flash 284B (13B active)

on NVIDIA RTX 4090 · Blaze

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
8.0 t/s gen
Quant
IXQ2/Q3
System RAM
64 GB
VRAM reported
24 GB

Summary

User reports DeepSeek V4 Flash (v4-flash-0731) at about 8 t/s on a single RTX 4090 with 64 GB RAM. Setup is the Blaze engine with Unsloth's IXQ2/Q3 checkpoint, keeping heavily utilized experts in RAM with the CPU. Throughput drops to 5 t/s on an expert miss that causes a disk read. Prefill is a work in progress.