DeepSeek V4.1
2× AMD RX 7900 XTX · Dspark
- generation:
- 9.0 tokens/s
- prompt processing (prefill):
- 150.0 tokens/s
- quant:
- IQ2
User reports DeepSeek V4.1 at 9 t/s decode average on an RX 7900 XTX 24GB plus W6800 32GB, with prefill around 150 t/s. Setup is Dspark with mostly IQ2 weights and Q6 n-grams, about 350GB on disk, streamed from a PCIe gen3 NVMe drive on a Ryzen 9 3950X with 96GB dual-channel DDR4 at 3000MHz. Decode varied widely: peaks of 19 t/s, usually around 13 t/s, dropping to 3 t/s when I/O was needed. User calls the model very smart but says it thinks a lot, so the slow average limits it to chatting.