DeepSeek V4.1 Flash 552B (16B active)
on NVIDIA RTX 3090 · ik_llama.cpp
Summary
User reports DeepSeek V4.1 Flash at 6-7 tok/s on a single RTX 3090 with 128GBx3 DDR4-2933 LRDIMM and a 4-bit quant.
Setup uses ik_llama.cpp with experts streamed from SSD and on-demand expert streaming to GPU; there is a 100-200 token warmup while experts populate.
User notes the machine is bottlenecked at 40GB/sec RAM throughput with three sticks and expects 20-30 tok/s with a fourth RAM chip. GLM 5.3 Flash support is also included but was slow.