Kimi K3 2800B (104B active)

User reports running Kimi K3 (2.8T) on a 16x GB10 cluster at ~30 t/s generation (peaking ~38 t/s) for coding and agentic tasks. Setup uses a customized gb10-vllm stack with custom MLA/KV kernels, dual MikroTik switches, and 4x 400G-to-4x100G breakout cables. Prefill throughput is ~750–910 t/s. Stable multi-hundred-thousand token context runs with multiple 500k compaction; handles concurrent requests without dropping token generation rates.