llamaperf

Qwen3.8 27B

on M4 Pro 48GB · Kapitsa

Tone: positiveApple hardware
Oct 19, 2026
Throughput
63.0 t/s gen
Quant
4bit (MLX)
System RAM
48 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 27B at 63 tok/s on an M4 Pro 48GB MacBook Pro with the Kapitsa engine, ahead of mlx-serve at 54 and Ollama at 32. Setup is Kapitsa with 4-bit MLX weights and speculative decoding (DFlash2), with part of each layer's prefill on the Neural Engine. The post is an engine release with comparison tables across M4 Pro 48GB, M5 Max 128GB and M1 Pro 16GB; on the M5 Max, Qwen3.8 27B reaches 115 tok/s and Qwen3.6 35B-A3B 272 tok/s, while Flash-Next 180B-A7B at 105 tok/s trails mlx-serve and oMLX by 2-3%.