llamaperf

Tiel-Coder 35B (3B active) AX , native decode / python-lru

on M2 Ultra 192GB · AX Engine (574d2d19 + 5e07befe; MLX 0.32.2)

Apple hardware
Oct 11, 2026
Throughput
134.6 t/s gen
Quant
AXQ-MXFP4 (MLX)
MTP (Multi-Token Prediction)
on
System RAM
192 GB

Use cases

coding

Summary

User reports Tiel-Coder 35B-A3B at 134.6 t/s median native decode on a single Apple Mac Studio M2 Ultra with 192 GiB unified memory. Setup is AX Engine with the AXQ-MXFP4 MLX export, explicit throughput-MTP at maximum draft depth three, expert streaming off, and the model kept fully resident. Separate median completion throughput is 107.28 t/s including TTFT, with median native TTFT 494.41 ms; the 256-token output is total output, not the decode numerator.