llamaperf

Cyber-Tiel-Coder 35B-A3B / AX normal wiring / python-lru 219 input, 256 output / MTP

on M2 Ultra 192GB · AX Engine

Apple hardware
Oct 13, 2026
Throughput
152.5 t/s gen
Quant
AXQ MXFP4 mixed (MLX)
MTP (Multi-Token Prediction)
on
System RAM
192 GB

Summary

User reports Cyber-Tiel-Coder-35B-A3B at 152.5 t/s on an M2 Ultra 192GB Mac Studio. Setup is the AX Engine with an AXQ MXFP4 trunk and protected MTP sidecar, one Metal GPU, expert streaming off. The figure is the median decode rate over six samples on a 219-input/256-output python-lru workload, with TTFT 505.93 ms; completion including TTFT was 117.59 t/s.