llamaperf
May 1, 2026
Throughput
9.7 t/s gen · 264.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
VRAM reported
32 GB

Summary

User reports Kimi K2.6 at 264 t/s prompt processing and 9.7 t/s generation on 32x AMD MI50 32GB GPUs.