KAT-Coder V2.5-Dev 35B (3B active)

User benchmarks KAT-Coder-V2.5-Dev, a 35B MoE, on an Intel Arc 140V iGPU in an MSI Claw 8 AI+ handheld with 32 GB shared LPDDR5x. Setup is vLLM 0.31.0+xpu with W4A16 GPTQ weights, FP8 KV cache, 131072-token context and MTP speculative decoding with 2 draft tokens. GPTQ decodes at 23.4-25.2 tok/s, peaking at 29.1 tok/s, and finishes 164 HumanEval problems in 42m 12s versus 47m 33s for MXFP4. Prefill runs 51-140 tok/s on short prompts and 398-500 tok/s on 2k-4k prompts, with both quants hitting a 1,247.1 tok/s chunked-prefill ceiling. MTP accepts 2.55-2.71 tokens per step at a 77.3-82.5 acceptance rate, roughly doubling throughput from about 11 tok/s.