DeepSeek V4.1 Flash 552B (16B active)
on NVIDIA RTX 4090 · Xolotl · 512,000 ctx
Use cases
codingtool-useagentic
Summary
User reports DeepSeek-V4.1-Flash (552B) at 27 tok/s decode on a single RTX 4090, with prefill of 180-320 tok/s.
Setup is the Xolotl engine (based on Strata) with a 152 GiB uncensored GSQ quant, 512K context, weights spread across 24GB VRAM, 90GB DDR4 and NVMe on a Ryzen 7 5700X.
User also reports 21/21 HumanEval, 10/10 tool calls and 3/3 agentic bug-fix loops through the real server with thinking on, and says the engine also runs GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B.