llamaperf

GLM-5.3 320B (18B active) Flash

on M5 Ultra 256GB · oMLX

Tone: positiveApple hardware
Oct 22, 2026
Throughput
80-100 t/s gen
Quant
oQ4e
System RAM
256 GB

Summary

User reports GLM 5.3 Flash on an M5 Ultra 256GB with oMLX 0.7.1, gaining about 20-30 tok/s on long running tasks at single concurrency versus 0.7.0, which was around 60-80 tok/s. Setup is oMLX 0.7.1 with an oQ4e quant on a single machine. With Lightning MTP enabled the user gets anywhere from 80-100 tok/s.