llamaperf

Kimi K3.1

on M5 Max 128GB · ds4

Apple hardware
Nov 10, 2026
Throughput
2.0 t/s gen · 8.4 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
System RAM
128 GB

Summary

User reports Kimi 3.1 running locally on a MacBook Pro M5 Max 128GB at 2 tok/s decode and 8.4 tok/s prefill. The run uses a source build of the ds4 engine with weights downloaded separately. No quant, context length or KV cache setting is stated.