Qwen3.8 27B
on Intel Arc Pro B60 24GB · intel-llm-scaler · 95,000 ctx
Use cases
coding
Summary
User reports Qwen3.8-27B at a stable 22 t/s generation with up to 95k context on an Intel Arc Pro B60 24GB connected via Oculink to a GMKTEC M7 Pro with 32 GB RAM.
Setup is intel-llm-scaler with an INT4 quant. The user also tried a Swift-Qwen3.8 fine-tune and MTP, but MTP limited context to about 50k and produced garbage quickly. llama.cpp was slower than vLLM on both Vulkan and SYCL.
User asks whether better options exist for a 24 GB card than Qwen3.8-27B, mentioning Qwen3.8-Next-Flash as likely too heavy.