llamaperf

Qwen3.5 9B

on M5 Max 36GB · Rapid-MLX

Apple hardware
Oct 13, 2026
Throughput
115.5 t/s gen
Quant
4-bit (MLX)
MTP (Multi-Token Prediction)
on
System RAM
36 GB

Summary

User reports Qwen3.5 9B at 115.5 t/s on a single Mac Studio with an M5 Max and 36 GB of unified memory. Setup is Rapid-MLX 0.16.1 with MLX 4-bit weights and MTP speculative decoding on the text-only lane, with image input disabled. The figure is the article's rounded single-stream decode rate, client-observed streaming decode-phase throughput rather than engine-native timing, and configured context capacity and KV precision are unknown.