Qwen3 30B (3B active)
on M5 32GB · MLX
Summary
User reports Qwen3-30B-A3B 4-bit at 57 tok/s cold generation on an M5 MacBook Air with 32GB.
Setup is MLX with mlx-lm, 4-bit weights, 256 generated tokens, no speculative decoding.
Sustained generation drops to 44 tok/s on battery and 39 tok/s on mains; prompt processing of a 4,096-token prompt is 1,063 tok/s cold, 788 sustained on battery and 725 on mains. The decline finishes at about 150 seconds and the rate then holds flat.