llamaperf

Qwen3.8 27B

on M1 Max 32GB · MLX

Apple hardware
Sep 9, 2026
Throughput
15.8 t/s gen · 81.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4bit
System RAM
32 GB
VRAM reported
32 GB

Summary

User compares MLX and llama.cpp on Qwen3.8-27B. MLX reaches 15.81 t/s generation and 81.76 t/s prompt processing. llama.cpp reaches 9.69 t/s generation and 99.61 t/s prompt processing. The llama.cpp run uses the UD-Q4_K_M quant.