llamaperf

Qwen3.5 9B

on M5 16GB · QVex-3.5

Tone: positiveApple hardware
Oct 20, 2026
Throughput
33-37 t/s gen
Quant
qvex-q4 (MLX)
System RAM
16 GB

Use cases

agentic

Summary

User reports Qwen3.5-9B running at about 25 tok/s without speculation and 33-37 tok/s with MTP speculative decoding on a fanless MacBook Air M5 16GB. Setup is a custom MLX engine (QVex-3.5) with a self-made qvex-q4 4-bit imatrix quant, using Qwen's own MTP head as the draft model (about 490 MB). The custom quant is 2.7x closer to bf16 than stock MLX 4-bit (KL 0.026 vs 0.069). A 3-bit build was about 13% faster but used 20-45% more energy per token, and MTP costs 10-25% more energy per token. With a 512-token thinking budget the model solved 24/24 tasks; the user calls this a sanity check rather than a benchmark, tested on one machine only.