Qwen3.8 125B (6B active) Flash-Next
on 4× Intel Arc Pro B70 · vLLM · 262,144 ctx
Oct 9, 2026
Summary
User reports Qwen3.8 Flash-Next at ~70 t/s generation and ~2800 t/s prefill on 4x Intel Arc Pro B70 GPUs.
Setup is vLLM with Intel's W4A16-AutoRound quant, full 262K FP8 context, prefix caching, and concurrency=2.
The user notes an alternative setup reached ~100 t/s generation but only ~1400 t/s prefill and 16-bit context, and considers the doubled prefill and context worth the ~30 t/s generation loss.