DeepSeek V4.1
on 2× AMD RX 7900 XTX · Dspark
Summary
User reports DeepSeek V4.1 at 9 t/s decode average on an RX 7900 XTX 24GB plus W6800 32GB, with prefill around 150 t/s.
Setup is Dspark with mostly IQ2 weights and Q6 n-grams, about 350GB on disk, streamed from a PCIe gen3 NVMe drive on a Ryzen 9 3950X with 96GB dual-channel DDR4 at 3000MHz.
Decode varied widely: peaks of 19 t/s, usually around 13 t/s, dropping to 3 t/s when I/O was needed. User calls the model very smart but says it thinks a lot, so the slow average limits it to chatting.