llamaperf

Mimo 2.5

on M2 Ultra 192GB · llama.cpp · 65,536 ctx

Apple hardware
Oct 9, 2026
Throughput
37.9 t/s gen · 301.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q3_K_M (GGUF)
KV cache
q8_0
System RAM
192 GB

Use cases

codingagentic

Summary

User reports MiMo-V2.5 at 37.87 t/s generation and 301.61 t/s prompt processing on an M2 Ultra 192GB Mac Studio. Setup is llama.cpp llama-server with UD-Q3_K_M GGUF, q8_0 KV cache, 65,536 context, Flash Attention on, gpu_layers 999, batch 2048, and 8,192 MiB cache_ram. Figures are token/time-weighted across four sequential real-world agentic tasks (n=1 each), not llama-bench or end-to-end throughput; one task hit its 8,192-token output cap and 258 of 2,290 prompt tokens were cached. Server peak RSS was 131.015 GiB.