Tiel-Coder 35B (3B active) AX , native decode / python-lru
on M4 Pro 64GB · AX Engine (574d2d19 + 5e07befe; MLX 0.32.2)
Use cases
coding
Summary
User reports Tiel-Coder 35B-A3B at 109.1 t/s median native decode on a single Apple Mac mini M4 Pro with 64 GiB unified memory.
Setup is AX Engine with the AXQ-MXFP4 MLX export, expert streaming off, and speculative decoding at maximum draft depth three.
The figure is native decode only, measured over six requests on a python-lru prompt with 194 input tokens and 256 total output tokens; separate median completion throughput including TTFT is 90.46 t/s.