Summary
User reports DeepSeek V4.1 Flash 1017 running at up to 40 tok/s, averaging around 30 tok/s, on 2x CMP 170HX plus an RTX 5060 Ti 16GB (144GB total VRAM) with 128GB DDR4-3000 and an Intel Core i9-10980XE.
Setup uses LibertAIDAI's EXL3 2.9 bpw quantization with DSpARK enabled and expert caching: 93% of routed experts run on the GPUs, the rest on the CPU, with frequently used experts migrated to VRAM in the background.
Prefill is around 400 tokens/sec, which the user calls slow. The 40 tok/s is a peak; the average is about 30 tok/s.