llamaperf

Qwen3.8 27B

on Intel Arc Pro B70 · llama.cpp

Intel hardware
Sep 28, 2026
Throughput
25.6 t/s gen · 512.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
96 GB
VRAM reported
32 GB

Summary

User benchmarks Qwen3.8 27B at 25.6 t/s generation and 512.14 t/s prompt processing on an Intel Arc Pro B70 32GB. Setup is llama.cpp with Q4_K_M weights on Windows 11, comparing SYCL and Vulkan backends; the reported figures are the Vulkan llama-bench results (tg128 25.60 t/s, pp128 512.14 t/s). Vulkan was roughly 3x faster at prompt processing and about 25% faster at generation than SYCL in llama-bench. In a real long business plan generation, Vulkan gave 517.15 t/s prompt processing and 16.17 t/s generation versus SYCL's 238.78 t/s and 17.39 t/s, but the user notes the Vulkan run processed 11,359 prompt tokens against 1,842 on SYCL, so those chat numbers are not apples to apples. The user also finds SYCL 10% to 35% faster on Linux.