llamaperf
Oct 12, 2026
Throughput
73.1 t/s gen
Quant
oQ5 affine mixed precision, group 64 (MLX)
MTP (Multi-Token Prediction)
off
System RAM
256 GB

Summary

User reports Ling-3.0 Flash at 73.1 t/s on an M3 Ultra 256GB. Setup is oMLX with oQ5 affine mixed precision, group 64, on a 124B total / 5.1B active model. The figure is the median of three greedy 256-token runs (73.23, 73.10, 73.09) after a 256-token warm-up, with a 39-token prompt; peak memory is reported at 87.44 GB.