Qwen3.8 27B
on M5 Pro 64GB · Inco Splash · 4,096 ctx
Oct 6, 2026
Summary
User benchmarks Qwen3.8 27B at 35.28 t/s decode and 528.91 t/s prefill on an M5 Pro 64GB Mac Mini.
Setup is Splash with Q8_0 GGUF weights and 4k input prompts.
User also compares llama.cpp, MLX, and Splash across several quants, and reports an M1 Max 64GB Splash run at 135.96 t/s decode and 915.01 t/s prefill. User settled on Splash with Q8_0 and is happy with the results.