Kimi K3.1
on M5 Max 128GB · ds4
Summary
User reports Kimi 3.1 running locally on a MacBook Pro M5 Max 128GB at 2 tok/s decode and 8.4 tok/s prefill.
The run uses a source build of the ds4 engine with weights downloaded separately.
No quant, context length or KV cache setting is stated.