llamaperf
Oct 11, 2026
Throughput
30.2 t/s gen · 309.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_XS
MTP (Multi-Token Prediction)
off
System RAM
192 GB

Summary

User reports MiniMax M2.7 230B-A10B at 30.2 t/s generation and 309 t/s prompt processing on an AMD Gorgon Halo 192GB machine. Setup is llama.cpp with UD-IQ4_XS, Vulkan backend, all layers on GPU, on a Minisforum MS-S1 MAX-P495 with Ryzen AI Max+ PRO 495 and 192 GB unified memory. The 309 t/s and 30.2 t/s come from separate llama-bench pp512 and tg128 tests at empty prior context, not a paired 512-input/128-output run; the source also reports about 51 t/s prompt and 14.7 t/s generation at roughly 32k depth.