Qwen3.8 27B dense
on M6 24GB · mlx-vlm
Oct 9, 2026
Use cases
summarization
Summary
User reports Qwen3.8 27B at 9.83 t/s generation on a Mac mini M6 24GB, from a 525-token prompt.
Setup is mlx-vlm 0.7.3 with the mlx-community 4-bit checkpoint, one request, speculative decoding off.
This is the plain baseline from a single run in the author's MTP comparison. The 268 t/s prefill in the source is the prompt divided by time to first token, so no prompt speed is stored.