- generation:
- 25-33 tokens/s
- prompt processing (prefill):
- 900-1100 tokens/s
- quant:
- IQ2_XXS (GGUF)
User reports DeepSeek V4.1 Flash at around 25-33 t/s decode and 900-1100 t/s prefill at 128-256K context on an unlocked CMP 170HX 64GB, with prefill dropping to 520 t/s at 1M context. Setup is Strata (Project Maya) with an IQ2_XXS GSQ-RCO GGUF at 2.0 bpw, on a Dell R740 server with 256GB DDR4-2133 ECC RAM, GPU capped at 150W and running at 85C without a fan. User asks how others run this card with this model, and says the low-bit DeepSeek V4.1 Flash beats the Qwen3.8-Flash-Next Q6 they ran before on quality, though they avoid expert-preference optimizations that trade quality for speed.