llamaperf

DeepSeek V4.1 Flash 552B (16B active)

on NVIDIA RTX 4090 · Xolotl · 512,000 ctx

Tone: positiveNVIDIA hardware
Oct 18, 2026
Throughput
27.0 t/s gen · 180-320 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
GSQ Uncensored
System RAM
90 GB
VRAM reported
24 GB

Use cases

codingtool-useagentic

Summary

User reports DeepSeek-V4.1-Flash (552B) at 27 tok/s decode on a single RTX 4090, with prefill of 180-320 tok/s. Setup is the Xolotl engine (based on Strata) with a 152 GiB uncensored GSQ quant, 512K context, weights spread across 24GB VRAM, 90GB DDR4 and NVMe on a Ryzen 7 5700X. User also reports 21/21 HumanEval, 10/10 tool calls and 3/3 agentic bug-fix loops through the real server with thinking on, and says the engine also runs GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B.