llamaperf

GLM-5.3 320B (18B active) Flash

on M5 Ultra 256GB · oMLX

Tone: mixedApple hardware
Oct 28, 2026
Throughput
80-90 t/s gen · 1600.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
oQ4e
System RAM
256 GB

Summary

User reports GLM-5.3 Flash at 80-90 t/s generation and 1.6k t/s prefill on a Mac Studio M5 Ultra 256GB (64-core), short of the 140-150 t/s and ~2k pp seen in oMLX benchmark recipes. Setup is oMLX 0.7.3rc1 (build 3517) with oQ4e quants, both Jundot's GLM-5.3-Flash-oQ4e-mtp and a self-quantized oQ4e from FP8. MTP was used, and DFlash2, patch-size changes and other tweaks were tried without reaching the target speeds.