Qwen3.8 27B
on M5 Max 36GB · Rapid-MLX
Summary
User reports Qwen3.8-27B at 37.9 t/s on an Apple M5 Max with 36 GB of unified memory.
Setup is Rapid-MLX 0.16.1 default with MLX 4-bit weights and MTP speculative decoding on the text-only lane, image input disabled.
The figure is a single-stream decode rate, not end-to-end throughput or prompt processing, and comes from a median of three requests with a 512-token cap.