llamaperf

Qwen3.6 27B

on M3 Max 128GB · MLX · 290,000 ctx

Tone: mixedApple hardware
May 1, 2026
Throughput
5-6 t/s gen · 160.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8 (MLX)
VRAM reported
128 GB

Use cases

long-context

Summary

User reports 160 t/s prefill and 5-6 t/s generation on an M5 Max 128GB with Qwen 3.6 27B Q8 MLX at 290k context. GPU utilization sits at only 36-50%. User expected 8-14 t/s generation and asks how other setups compare.