llamaperf

Qwen3.8 27B

on M5 Pro 64GB · Tensorfold

Tone: positiveApple hardware
Sep 30, 2026
Throughput
40-60 t/s gen
Quant
4bit (MLX)
System RAM
64 GB

Use cases

coding

Summary

User reports Qwen3.8-27B at 40-60 t/s on an M5 Pro Mac mini with 64GB RAM using the Tensorfold engine. Setup is Tensorfold with the Vontra/Qwen3.8-27B-MLX-4bit model and z-lab/Qwen3.8-27B-DFlash2 draft model for speculative decoding. The user compares this to an RTX 3090 Ti running Qwen3.8-27B-GSQ-RCO-GGUF with MTP IQ3_S at 50-70 tok/s, noting the 3090 Ti has roughly 4x faster prefill. They are considering replacing the 3090 Ti with the Mac mini as their main inference server.