llamaperf

Qwen3.8 27B dense

on M6 24GB · mlx-vlm

Apple hardware
Oct 9, 2026
Throughput
9.8 t/s gen
Quant
4bit (MLX)
MTP (Multi-Token Prediction)
off
System RAM
24 GB

Use cases

summarization

Summary

User reports Qwen3.8 27B at 9.83 t/s generation on a Mac mini M6 24GB, from a 525-token prompt. Setup is mlx-vlm 0.7.3 with the mlx-community 4-bit checkpoint, one request, speculative decoding off. This is the plain baseline from a single run in the author's MTP comparison. The 268 t/s prefill in the source is the prompt divided by time to first token, so no prompt speed is stored.