- generation:
- 64.1 tokens/s
User benchmarks DeepSeek-V4.1-Flash on a single M5 Ultra 512GB Mac Studio, averaging 64.1 tok/s generation and 3,101 tok/s prefill over 512 to 256k contexts. Setup is mlx-serve 26.11.2 with an MLX model; the dual-node run used two M5 Ultra 512GB machines over a single Thunderbolt RDMA link with experts split across nodes. Two nodes averaged 78.8 tok/s generation (+23%) but prefill fell to 2,812 tok/s (-9%) and 256k TTFT rose from 81.4 to 106.0 s. RDMA was unstable with three queue-pair failures, and the user advises against a dual 256GB Ultra setup in favour of a single 512GB machine.