llamaperf

DeepSeek V4.1 Flash 552B (16B active)

on NVIDIA RTX 3090 · delta-inference-engine · 1,000,000 ctx

Tone: positiveNVIDIA hardware
Oct 28, 2026
Throughput
41.0 t/s gen
Quant
Q2 (GGUF)
System RAM
192 GB
VRAM reported
24 GB

Summary

User reports DeepSeek-V4.1-Flash-1017 at 41 tok/s on a single RTX 3090 with 192 GB of system RAM, averaged across multiple prompts. Setup is the user's delta-inference-engine (a Windows port of Xolotl, built on Strata) running nazeshinjite's Q2 GGUF natively on Windows, with the model streamed from a 366 GB download and a 1M context. The user says output matches DeepSeek's API next token 90.2% of the time on general text and 92.4% on code/math. The same table gives 33 tok/s with 128 GB RAM, and the needs list gives 31 tok/s at 16 GB VRAM and 17 tok/s at 12 GB VRAM. Other quants measured 38 to 42 tok/s.