llamaperf

Qwen3 8B

on Intel Arc Pro B70 · llama.cpp · 2,048 ctx

Intel hardware
Oct 5, 2026
Throughput
77.7 t/s gen · 1172.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
FP16
System RAM
16 GB
VRAM reported
32 GB

Summary

User benchmarks Qwen3 8B at 77.70 t/s generation and 1172.08 t/s prompt processing on an Intel Arc Pro B70 32GB external GPU. Setup is llama.cpp b10852 with Q4_K_M GGUF, FP16 KV cache, flash attention, 512 batch, 10 CPU threads, full GPU offload via SYCL backend on Windows. SYCL repeat measured 83.51 t/s generation; Vulkan and CUDA backends were also tested. A separate 49B capacity test with Llama 3.3 Nemotron Super 49B Q4_K_M achieved 15.99 t/s generation at depth 0 with all 81 layers offloaded.