llamaperf

Qwen3.8 27B

on M5 Max 128GB · kapitsa

Tone: positiveApple hardware
Oct 24, 2026
Throughput
140.0 t/s gen
Quant
4bit
System RAM
128 GB

Summary

User reports Qwen3.8-27B at 140 tok/s on an M5 Max MacBook Pro with 128GB, the fastest run of their open source Apple Silicon engine kapitsa. Setup is kapitsa with a 4bit model and kflash speculative decoding, where the 27B verifies a tree of drafter guesses in one pass rather than a single chain. The user is asking Mac Studio owners to run the same model for comparison.