llamaperf
Submit

Qwen3.8 27B

on M4 Pro 24GB · llama.cpp

Apple hardware
Oct 12, 2026
Throughput
11.4 t/s gen · 96.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
Flash Attention
on
System RAM
24 GB

Summary

User reports Qwen3.8 27B at 11.4 t/s generation and 96.8 t/s prompt on a Mac mini M4 Pro with 24GB unified memory. Setup is llama.cpp b10488 with Metal, Flash Attention on, all layers offloaded, and Q4_K_M quant. The figures come from separate llama-bench pp2048 and tg128 tests, mean of three repetitions, not one request; run-to-run variance is claimed under 3%.