Qwen3.8 27B
on M5 Pro 64GB · Tensorfold
Use cases
coding
Summary
User reports Qwen3.8-27B at 40-60 t/s on an M5 Pro Mac mini with 64GB RAM using the Tensorfold engine.
Setup is Tensorfold with the Vontra/Qwen3.8-27B-MLX-4bit model and z-lab/Qwen3.8-27B-DFlash2 draft model for speculative decoding.
The user compares this to an RTX 3090 Ti running Qwen3.8-27B-GSQ-RCO-GGUF with MTP IQ3_S at 50-70 tok/s, noting the 3090 Ti has roughly 4x faster prefill. They are considering replacing the 3090 Ti with the Mac mini as their main inference server.