llamaperf

M6 24GB reports

1 report. These are individual setups, not a controlled benchmark. M6 24GB speeds and models →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

Apple hardware
generation:
9.8 tokens/s
quant:
4bit (MLX)
mtp (multi-token prediction):
off
summarization

User reports Qwen3.8 27B at 9.83 t/s generation on a Mac mini M6 24GB, from a 525-token prompt. Setup is mlx-vlm 0.7.3 with the mlx-community 4-bit checkpoint, one request, speculative decoding off. This is the plain baseline from a single run in the author's MTP comparison. The 268 t/s prefill in the source is the prompt divided by time to first token, so no prompt speed is stored.

Oct 9, 2026