llamaperf

Kimi K2.6

on 8× NVIDIA RTX Pro 6000 Blackwell · vLLM · 262,144 ctx

NVIDIA hardware
Oct 4, 2026
Throughput
112.5 t/s gen
KV cache
fp8

Summary

User reports Kimi-K2.6 at 112.5 tok/s single-stream decode on 8x RTX PRO 6000 Blackwell. Setup is vLLM with fp8 KV cache, TRITON_MLA attention, TP=8, DCP=8, and Eagle3 MTP speculative decoding with 3 tokens using the lightseekorg/kimi-k2.5-eagle3-mla draft model. The 112.5 tok/s is the DCP=1 + MTP=3, 0-context, concurrency-1 cell from an aggregate decode matrix; the page also gives DCP=1 no-MTP (91.5), DCP=4 MTP (101.5), DCP=8 MTP (89.4) and DCP=8 no-MTP (75.5) at the same cell, plus prefill of 7892 tok/s at 8k and 5604 tok/s at ~83k. An erratum notes the old 128k rows were actually ~83k prompt tokens.