llamaperf

Cyber-Tiel-Coder 35B-A3B / AX normal wiring / python-lru 219 input, 256 output / MTP

on M3 Ultra 512GB · AX Engine

Apple hardware
Oct 13, 2026
Throughput
218.8 t/s gen
Quant
AXQ MXFP4 mixed (MLX)
MTP (Multi-Token Prediction)
on
System RAM
512 GB

Summary

User reports Cyber-Tiel-Coder-35B-A3B at 218.8 t/s on an M3 Ultra with 512GB unified memory. Setup is the AX Engine with an AXQ MXFP4 trunk and protected MTP sidecar, one Metal GPU, expert streaming off, greedy decoding at MTP depth 3. The figure is the median decode rate over six samples on a 219-input/256-output python-lru workload, with a range of 217.75-220.11 t/s; completion including TTFT was 170.65 t/s.