Qwen3.8 27B
on Intel Arc Pro B70 · vLLM · 128,000 ctx
Sep 7, 2026
Use cases
codingagenticvisiontool-use
Summary
User reports Qwen3.8-27B at a median 52.2 tok/s decode and 763 tok/s prefill at 111.8K tokens on an Intel Arc Pro B70 32GB.
Setup is vLLM XPU with the GPTQ INT4 quant, MTP2 speculative decoding, an FP8 KV cache, and 128K context.
Vision, tool calling, and agent tests pass. vLLM beats llama.cpp SYCL by about 1.8x. An MTP plus concurrency crash was fixed with max-num-seqs 1, and a prefix caching bug was patched.