llamaperf

Qwen3.6 35B (3B active)

on Intel Arc Pro B70 · llama.cpp

Intel hardware
Sep 30, 2026
Throughput
76.0 t/s gen · 1225.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
q4_0
System RAM
32 GB
VRAM reported
32 GB

Summary

User benchmarks Qwen3.6-35B-A3B at 76.0 t/s single-stream decode and 1,225 t/s prefill on one Intel Arc Pro B70 32GB. Setup is llama.cpp with the Vulkan backend, Q4_K_M quant and q4_0 KV cache, no speculative decoding. The host has 32 GB RAM. With --ubatch-size 2048 prefill reaches 1,824 t/s at pp2048 and 8-stream aggregate decode is 624 t/s. The SYCL backend gives 77.3 t/s decode and 979 t/s prefill at pp2048. A dense Qwen3.6-27B Q4_K_XL comparison runs at 20 t/s single stream.