llamaperf

Qwen3.6 27B

on M5 Max 128GB · MLX · 290,000 ctx

Tone: mixedApple hardware
May 2, 2026
Throughput
5-6 t/s gen · 160.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8 (MLX)
System RAM
128 GB
VRAM reported
128 GB

Use cases

long-context

Summary

User reports 160 t/s prefill and 5-6 t/s generation on an M5 Max 128GB with Qwen 3.6 27B Q8 MLX at 290k context. GPU utilization sits at only 36-50%. The user finds the generation rate low against an expected 8-14 t/s and asks others for comparison.