llamaperf

GLM-5.3 320B (18B active) Flash

on M5 Ultra 256GB · oMLX · 1,024 ctx

Apple hardware
Oct 24, 2026
Throughput
61.7 t/s gen · 1587.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
mixed-4_8bit (MLX)
System RAM
256 GB

Use cases

coding

Summary

User benchmarks GLM-5.3-Flash-MLX-mixed-4_8bit on an M5 Ultra 256GB with oMLX, reporting 61.7 t/s generation and 1587.5 t/s prompt processing at 1024-token prompt. Setup uses MLX mixed 4/8-bit weights with peak MLX memory of 174.17 GB; a 131k context prefill would need ~208.28 GB, exceeding the 205.80 GB prefill limit. At longer prompts generation stays 58.1-59.6 t/s and prefill 2323.9-2373.0 t/s; continuous batching reaches 67.3 t/s at 2x and 99.3 t/s at 4x.