llamaperf

Qwen3.6 35B (3B active)

on Unknown GPU · OpenVINO

Tone: negative
Oct 5, 2026
Throughput
10.0 t/s gen
Quant
INT4 (OpenVINO IR)

Summary

User reports Qwen3.6 35B-A3B MoE at ~10 tok/s on an Intel Arc integrated GPU (Arrow Lake-P, Core Ultra 9 285H). Setup is OpenVINO 2026.2.0 with INT4/INT8 weights (~21GB) in OpenVINO IR format. The same MoE model runs at 17-19 tok/s under llama.cpp Vulkan on the same iGPU, and the user notes the MoE is slower than a dense Qwen3-8B (12.1 tok/s) on OpenVINO. Per-layer IR analysis shows 78 ops/layer x 40 layers = 3,120 unfused operations for the MoE MLP, causing GPU underutilization.