llamaperf

Qwen3.8 27B

on M5 Max 36GB · Rapid-MLX

Apple hardware
Oct 13, 2026
Throughput
25.8 t/s gen
Quant
4-bit (MLX)
MTP (Multi-Token Prediction)
off
System RAM
36 GB

Summary

User reports Qwen3.8-27B at 25.8 t/s on an M5 Max with 36 GB of unified memory. Setup is Rapid-MLX 0.16.1 with MLX 4-bit weights and --no-spec-decode, running text prompts. The figure is a single-stream streaming decode rate, not engine-native timing or end-to-end throughput, and the harness requests a 512-token cap at temperature 0.