llamaperf

Qwen3.8 27B

on M4 Pro 48GB · Kapitsa

Apple hardware
Oct 21, 2026
Throughput
63.0 t/s gen
Quant
4-bit
System RAM
48 GB

Use cases

coding

Summary

User benchmarks Kapitsa 0.2 with its KFlash speculative decoding at 63 tok/s on Qwen3.8 27B on a MacBook Pro M4 Pro 48GB. Setup is Kapitsa with 4-bit weights, decoding a 512-token coding answer at temperature 0.6, median of 5 runs. The post also cites Splash 1.4.0 (DFlash2) at about 50 tok/s and Kapitsa at about 65 tok/s in its title, and mentions an M1 Pro 16GB MacBook Pro and Qwen3.8 4B/35B runs that are not shown in the excerpt.