llamaperf

Qwen3.8 27B

on Intel Arc Pro B60 24GB · llama.cpp · 32,768 ctx

Tone: positiveIntel hardware
Oct 11, 2026
Throughput
53.3 t/s gen · 420.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
F16
System RAM
32 GB
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-27B at 53.3 tok/s per-request decode (47 to 58 across eight requests) on an Intel Arc Pro B60 24GB. Setup is llama.cpp Vulkan build b11524 with Q4_K_M and an F16 KV cache, a DFlash2 draft model, one request at a time, 32K context, the whole model on the card. The repo's 42.3 tok/s headline is wall-clock eval-suite throughput with prompt processing included, not a decode rate; stock llama.cpp with no drafter gave 16 tok/s in llama-bench tg32. Prompt reading at 32K was 420 tok/s with the Intel FA kernel, versus 118 tok/s stock.