Qwen3.8 125B (6B active) Flash-Next
on 4× Intel Arc Pro B70 · vLLM
Summary
User reports Qwen3.8 Flash-Next FP8 with MTP at 450 t/s prefill and 20 t/s generation on 4x Intel Arc Pro B70 (128GB VRAM total).
Setup is vLLM in a container with 128GB system RAM, using the qfn-38-fp8-4xb70-mtp configuration.
The figures come from LLM-run tests and the user notes it is slower than some benchmarks found elsewhere; prior manual vLLM attempts on multiple B70 cards crashed for almost every model until 2^32 overflow fixes were backported.