Kimi K3
on NVIDIA RTX 3090 · 16,384 ctx
Summary
User reports Kimi K3 at 1.05 t/s generation and 5.66 t/s prompt processing on an RTX 3090 with 2 TB of Intel Optane PMem 200 in Memory Mode.
Setup uses a Supermicro X12SPA-TF with Intel Xeon 8370C, 256 GB DDR4-3200, and the UD-Q4_K_XL quant at 16k context.
App Direct mode gave lower throughput at 0.62 t/s generation and 4.9 t/s prompt processing. The user also benchmarked Kimi K2.5, GLM-5.3-753B, Hermes-4-405B, DeepSeek-V4-Flash, Nemotron-3-Super-120B-A12B, gpt-oss-120b, and Ornith-1.5-35B-A3B on the same system.