- generation:
- 55-65 tokens/s
- prompt processing (prefill):
- 900-1100 tokens/s
- quant:
- IQ2_XXS GSQ-RCO-GGUF (GGUF)
User reports DeepSeek V4.1 Flash running at 55-65 t/s decode and 900-1100 t/s prefill on a single unlocked CMP 170HX 64GB at 150W. Setup is Project Maya with an IQ2_XXS GSQ-RCO-GGUF (2.0 bpw) quant. Both figures are given as ranges. The user plans to retry at 250-300W once a server shroud arrives.