Kimi K3 2800B (104B active)
on 16× NVIDIA DGX Spark · vLLM · 300,000 ctx
Oct 4, 2026
Use cases
codingagentic
Summary
User reports Kimi K3 at 20 t/s on 16 DGX Sparks at 300k context, up from an unusable 7 t/s at 100k context.
Setup is vLLM across two joined 8-node DGX Spark clusters.
The user also ran Qwen 397B at 30 t/s on 4x GB10 and 50-60 t/s on 16x3090, Qwen 235B at 10-12 t/s and DeepSeek 671B at 8 t/s on a Threadripper with 512GB DDR4 and experts offloaded to RAM.