DeepSeek V4.1 Flash 552B (16B active)
on NVIDIA RTX 3060 12GB · PROMETHEVS
Use cases
codingagentictool-use
Summary
User reports the full DeepSeek-V4.1-Flash-1017 model at up to 7.4 tok/s warm (5.8 cold) on a 160-token code prompt, on an RTX 3060 12GB with 64 GB DDR4 and two NVMe drives.
Setup is the user's own PROMETHEVS engine, which streams the 510 GB original FP4 weights through VRAM, RAM and both drives, computing tokens on a 2-bit copy of the experts and recomputing uncertain tokens with the original weights; DeepSeek's draft head proposes blocks of five tokens.
Server runs give 5-8 tok/s on code and 4.5-5.4 on reasoning and agent prompts, against 2.14 tok/s for plain exact decoding of the full model on the same PC. Agreement with the full weights is 97.4% for the 2-bit copy alone and 98.3% with corrections over 960 audited tokens. Only tested on this one Windows machine so far, needs about 1.1 TB of NVMe, and has not been compared with DeepSeek's reference implementation.