Qwen3.8 27B
on M4 Pro 48GB · Kapitsa
Use cases
codingagentic
Summary
User reports Qwen3.8 27B at 63 tok/s on an M4 Pro 48GB MacBook Pro with the Kapitsa engine, ahead of mlx-serve at 54 and Ollama at 32.
Setup is Kapitsa with 4-bit MLX weights and speculative decoding (DFlash2), with part of each layer's prefill on the Neural Engine.
The post is an engine release with comparison tables across M4 Pro 48GB, M5 Max 128GB and M1 Pro 16GB; on the M5 Max, Qwen3.8 27B reaches 115 tok/s and Qwen3.6 35B-A3B 272 tok/s, while Flash-Next 180B-A7B at 105 tok/s trails mlx-serve and oMLX by 2-3%.