Qwen3.5 4B

User benchmarks Qwen3.5 4B at 133 tok/s on an M5 Max 36GB, part of a 32-model comparison across four Macs. Setup is Rapid-MLX with 4-bit weights and no speculative decoding, 512-token prompts generating 128 tokens, median of 5 runs after one warmup. The same model reaches 63 tok/s on an M2 Pro 32GB, 79 on an M4 Pro 48GB and 159 on an M3 Ultra 256GB. On MoE models the M5 Max matches or beats the M3 Ultra, while the dense Qwen3.8 27B at 3.5bpw is faster on the Ultra (37 vs 28 tok/s). One 1024x1024 image with Qwen-Image 2.1 took 38 s on the M5 Max and 83 s on the M3 Ultra. The author works on Rapid-MLX and notes other runtimes will give different absolute numbers.