llamaperf

Qwen3.8 27B

on M5 Pro 48GB · llama.cpp

Tone: mixedApple hardware
Sep 7, 2026
Throughput
19.0 t/s gen · 300-350 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
System RAM
48 GB

Summary

User compares MLX and GGUF for Qwen3.8 27B on an M5 Pro, reporting generation at about 19 t/s. Setup is llama.cpp with Metal, which the user says now matches MLX prefill at roughly 300-350 t/s. The user questions whether MLX is still needed and mentions MTP and oMLX.