Qwen3.8 27B
on 2× Intel Arc Pro B70 · llama.cpp · 200,000 ctx
Use cases
codingagenticlong-context
Summary
User reports Qwen3.8-27B at 51 t/s average decode and 838 t/s prompt processing across about 1,030 real agentic coding requests on 2x Arc Pro B70 32GB.
Setup is llama.cpp SYCL with tensor parallel across both cards, Q8_0 weights, a DFlash2 drafter at Q4_K_M, 200K context and temp 1.0 on Windows 11.
Decode ranged from 47 t/s at 40-80K context to 61 t/s at 160K+, rising at high context because more drafts get accepted; a fresh 94K prompt prefills at about 1,070 t/s. The user also reports a oneAPI 2026.1 runtime leak that pushed private memory to 92 GB and slowed decode from 64 to 200 ms per cycle, fixed with one SYCL context per GPU.