Mimo 2.5
M2 Ultra 192GB · llama.cpp · 65,536 ctx
- generation:
- 37.9 tokens/s
- prompt processing (prefill):
- 301.6 tokens/s
- quant:
- UD-Q3_K_M (GGUF)
- kv:
- q8_0
codingagentic
User reports MiMo-V2.5 at 37.87 t/s generation and 301.61 t/s prompt processing on an M2 Ultra 192GB Mac Studio. Setup is llama.cpp llama-server with UD-Q3_K_M GGUF, q8_0 KV cache, 65,536 context, Flash Attention on, gpu_layers 999, batch 2048, and 8,192 MiB cache_ram. Figures are token/time-weighted across four sequential real-world agentic tasks (n=1 each), not llama-bench or end-to-end throughput; one task hit its 8,192-token output cap and 258 of 2,290 prompt tokens were cached. Server peak RSS was 131.015 GiB.