Qwen3 8B
on Intel Arc Pro B70 · llama.cpp · 2,048 ctx
Oct 5, 2026
Summary
User benchmarks Qwen3 8B at 77.70 t/s generation and 1172.08 t/s prompt processing on an Intel Arc Pro B70 32GB external GPU.
Setup is llama.cpp b10852 with Q4_K_M GGUF, FP16 KV cache, flash attention, 512 batch, 10 CPU threads, full GPU offload via SYCL backend on Windows.
SYCL repeat measured 83.51 t/s generation; Vulkan and CUDA backends were also tested. A separate 49B capacity test with Llama 3.3 Nemotron Super 49B Q4_K_M achieved 15.99 t/s generation at depth 0 with all 81 layers offloaded.