Qwen3.8 125B (6B active) Flash-Next
on 4× 4x Intel Arc Pro B65 · vLLM
Summary
User benchmarks Qwen3.8-Flash-Next-W4A16 at 87.7 t/s median per-request decode on 4x Intel Arc Pro B65 (128GB total VRAM).
Setup is vLLM 0.30.0 with INT4 W4A16 weights at zero context, single request; the table also gives total throughput and medians at C2 and C4 and at contexts up to 200K.
Measurements are sustained-decode medians from 30-second tests, not totals divided by concurrency. A second Flash-Next run at the same settings reached 43.4 t/s at C1. The post also sweeps Qwen3.8-27B on 1x and 4x B65 in INT4, FP8 and BF16, and mentions starting layer offload to system RAM with Flash-Next.