Kimi K3 2800B (104B active)
on M4 Max 64GB · WASTE · 4,096 ctx
Summary
User reports running the full 2.78T-parameter Kimi K3 on a 64 GB MacBook Pro at around 0.32–0.34 tokens per second.
Setup is the WASTE (Weight-Aware Streaming Tensor Engine) with a 982 GiB NVMe-optimized container, streaming routed experts from disk and caching them in RAM, at a 4K context with a measured minimum memory requirement of approximately 29 GB.
The engine needs roughly 17 GB of expert data per token and more than half of decode time is spent reading experts from disk. The same engine runs Kimi-Linear 48B from a 19 GB container at 8.92 tokens per second with an 8 GB memory budget.