Qwen3.8 27B dense
M6 24GB · mlx-vlm
- generation:
- 9.8 tokens/s
- quant:
- 4bit (MLX)
- mtp (multi-token prediction):
- off
summarization
User reports Qwen3.8 27B at 9.83 t/s generation on a Mac mini M6 24GB, from a 525-token prompt. Setup is mlx-vlm 0.7.3 with the mlx-community 4-bit checkpoint, one request, speculative decoding off. This is the plain baseline from a single run in the author's MTP comparison. The 268 t/s prefill in the source is the prompt divided by time to first token, so no prompt speed is stored.