Gemma 4
on Intel Arc · llama.cpp · 65,536 ctx
Summary
User reports Gemma 4 at 6.97 t/s generation on an Intel Arc GPU (Core Ultra 7 155U) with the SYCL backend, compared to 20.09 t/s on the Vulkan backend under identical conditions.
Setup is llama.cpp with Q4_K_M, flash attention on, 64k context, and MTP speculative decoding with a draft model.
Prompt processing was 25.59 t/s on SYCL versus 21.47 t/s on Vulkan, and draft acceptance was 51.07% on SYCL versus 59.61% on Vulkan.