llamaperf

Qwen3.5 9B

on M5 Max 36GB · Rapid-MLX

Apple hardware
Oct 13, 2026
Throughput
80.1 t/s gen
Quant
4-bit (MLX)
MTP (Multi-Token Prediction)
off
System RAM
36 GB

Summary

User reports Qwen3.5 9B at 80.1 t/s on a single Mac Studio with an M5 Max and 36 GB of unified memory. Setup is Rapid-MLX 0.16.1 with MLX 4-bit and --no-spec-decode, in image-capable mode benchmarked with text prompts. The 80.1 t/s is the article's rounded single-stream decode rate, measured as client-observed streaming decode throughput rather than engine-native timing; a separate four-stream run reached 77.0 t/s as an aggregate wall-throughput figure.