llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Intel Arc Pro B70 · llama.cpp · 262,144 ctx

Intel hardware
Oct 6, 2026
Throughput
31.2 t/s gen · 713.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q2_0 (GGUF)
KV cache
q8_0
System RAM
128 GB
VRAM reported
32 GB

Summary

User reports Qwen3.8-Flash-Next at 31.2 t/s generation and 713.7 t/s prompt processing on an Intel Arc Pro B70 32GB, after overclocking DDR5 memory from 3600MHz to 4800MHz. Setup is llama.cpp with a customized SYCL backend, Q2_0 GGUF quant, q8_0 KV cache, 262144 context, MTP speculative decoding, and 34 MoE layers offloaded to CPU. Overclocking gave about 10% higher prefill and 5% higher generation overall; the post compares base and overclocked llama-benchy numbers across context depths.