Kimi K3 2800B (104B active)
on M1 Max · Deltafin
Summary
User reports running the full 2.8-trillion-parameter Kimi K3 at 0.2901 token/s (3.447 s/token) on an M1 Max laptop using the Deltafin native binary.
Setup uses the Deltafin engine with all 16 experts routed and no pruning, plus the Kimi-K3-DSpark draft model (6.635 GiB on disk, ~4.49 GiB at runtime) for speculative decoding; an optional Qwen 0.6B/1.7B add-on (4.337 GiB) speeds raw completion by 2.7x on a 17-token test.
The figure is 1.9% higher than the previous update; historical M1 Max results were 0.2847, 0.2660, 0.1311 and 0.0141 token/s. The full model is 1.7 TB on disk, or 215 GB with streaming setup.