Qwen3.8 27B
on M4 Pro 48GB · Kapitsa
Use cases
coding
Summary
User benchmarks Kapitsa 0.2 with its KFlash speculative decoding at 63 tok/s on Qwen3.8 27B on a MacBook Pro M4 Pro 48GB.
Setup is Kapitsa with 4-bit weights, decoding a 512-token coding answer at temperature 0.6, median of 5 runs.
The post also cites Splash 1.4.0 (DFlash2) at about 50 tok/s and Kapitsa at about 65 tok/s in its title, and mentions an M1 Pro 16GB MacBook Pro and Qwen3.8 4B/35B runs that are not shown in the excerpt.