llamaperf

Qwen3.8 27B

on 2× Intel Arc Pro B70 · llama.cpp · 200,000 ctx

Tone: positiveIntel hardware
Oct 24, 2026
Throughput
51.0 t/s gen · 838.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
VRAM reported
32 GB

Use cases

codingagenticlong-context

Summary

User reports Qwen3.8-27B at 51 t/s average decode and 838 t/s prompt processing across about 1,030 real agentic coding requests on 2x Arc Pro B70 32GB. Setup is llama.cpp SYCL with tensor parallel across both cards, Q8_0 weights, a DFlash2 drafter at Q4_K_M, 200K context and temp 1.0 on Windows 11. Decode ranged from 47 t/s at 40-80K context to 61 t/s at 160K+, rising at high context because more drafts get accepted; a fresh 94K prompt prefills at about 1,070 t/s. The user also reports a oneAPI 2026.1 runtime leak that pushed private memory to 92 GB and slowed decode from 64 to 200 ms per cycle, fixed with one SYCL context per GPU.