Oct 5, 2026
Summary
User reports GLM-5.3 Flash at 68.8 tok/s on an M5 Ultra 256GB.
Setup is oMLX 0.7.0 with oQ4e quantization and MTP speculative decoding, with more optimization still to come.
Prefill is 1,878 toks. User shared the result because other benchmarks looked lower than expected.