Qwen3 4B
on Unknown GPU · GenieX
Summary
User reports Qwen3-4B-Thinking running at about 14 tok/s on the NPU of a Surface Laptop 7 (Snapdragon X Plus, 16 GB), and LFM2.5-8B-A1B at about 31 tok/s.
Setup is the GenieX engine with Q4_0 weights, run fully on the NPU; time to first token was up to about 18x faster than CPU.
In a GenieX vs Foundry Local express comparison, Foundry was faster on every comparable model (up to ~1.9x on 0.5B and 1.5B), and Phi-4-mini on Foundry Local scored 80/100 at 27.8 tok/s. Of 16 models fully tested, 10 ran on the NPU alone, 4 on NPU+CPU, 0 on CPU alone and 2 were undetermined.