llamaperf

Qwen3.8 27B

on Intel Arc Pro B70 · vLLM · 128,000 ctx

Tone: positiveIntel hardware
Sep 7, 2026
Throughput
52.2 t/s gen · 763.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
INT4 (GPTQ)
KV cache
FP8
System RAM
29 GB
VRAM reported
32 GB

Use cases

codingagenticvisiontool-use

Summary

User reports Qwen3.8-27B at a median 52.2 tok/s decode and 763 tok/s prefill at 111.8K tokens on an Intel Arc Pro B70 32GB. Setup is vLLM XPU with the GPTQ INT4 quant, MTP2 speculative decoding, an FP8 KV cache, and 128K context. Vision, tool calling, and agent tests pass. vLLM beats llama.cpp SYCL by about 1.8x. An MTP plus concurrency crash was fixed with max-num-seqs 1, and a prefix caching bug was patched.