Tiel-Coder 35B (3B active) AX , native decode / python-lru
on M2 Ultra 192GB · AX Engine (574d2d19 + 5e07befe; MLX 0.32.2)
Use cases
coding
Summary
User reports Tiel-Coder 35B-A3B at 134.6 t/s median native decode on a single Apple Mac Studio M2 Ultra with 192 GiB unified memory.
Setup is AX Engine with the AXQ-MXFP4 MLX export, explicit throughput-MTP at maximum draft depth three, expert streaming off, and the model kept fully resident.
Separate median completion throughput is 107.28 t/s including TTFT, with median native TTFT 494.41 ms; the 256-token output is total output, not the decode numerator.