Qwen3.8 27B
on 4× Intel B65 · vLLM
Use cases
long-context
Summary
User benchmarks Qwen3.8-27B at 50.9 t/s per request (50.4 t/s total) at concurrency 1 on a 4x Intel B65 rig.
Setup is vLLM 0.31.0+xpu.llmscaler with INT4 weights; figures are sustained-decode medians from 30-second tests.
Long-context sweep: per-request decode falls from 50.4 t/s at 8K to 42.5 t/s at 128K and 38.9 t/s at 200K. Aggregate throughput rises to 468.2 t/s at C8 and 458.1 t/s at C16, with per-request rates of 62.1 and 30.1 t/s.