llamaperf

Tiel-Coder 35B (3B active) AX , native decode / python-lru

on M4 Pro 64GB · AX Engine (574d2d19 + 5e07befe; MLX 0.32.2)

Apple hardware
Oct 11, 2026
Throughput
109.1 t/s gen
Quant
AXQ-MXFP4 (MLX)
MTP (Multi-Token Prediction)
on
System RAM
64 GB

Use cases

coding

Summary

User reports Tiel-Coder 35B-A3B at 109.1 t/s median native decode on a single Apple Mac mini M4 Pro with 64 GiB unified memory. Setup is AX Engine with the AXQ-MXFP4 MLX export, expert streaming off, and speculative decoding at maximum draft depth three. The figure is native decode only, measured over six requests on a python-lru prompt with 194 input tokens and 256 total output tokens; separate median completion throughput including TTFT is 90.46 t/s.