DeepSeek V4.1 Flash 552B (16B active)
M5 Ultra 512GB · oMLX · 128,000 ctx
- generation:
- 54.0 tokens/s
- prompt processing (prefill):
- 1100.0 tokens/s
- quant:
- oQ4e
User reports DeepSeek-V4.1-Flash-1017-oQ4e-mtp at up to 1100 t/s prompt processing and 54 t/s generation on a Mac Studio M5 Ultra with 512GB RAM. Setup is oMLX with an oQ4e quant and MTP speculation, a 128k context window, and engram tables stored on SSD to keep RAM free. Beyond 128k context both prefill and generation drop, and concurrent requests split the maximum generation speed between instances. The user asks whether this is the top speed without changing the model.