Gemma 4 8B E4B
on Radeon 860M · llama.cpp
Summary
User reports 6.65 t/s generation and 291.48 t/s prompt processing.
Source evidence (verbatim):
Source: https://blog.majid.info/llama-bench/xhystos.txt
# AMD Ryzen AI 7 350 / Radeon 860M, 32GB system RAM: original Gemma4 E4B Q4_K_M llama-bench log
First-hand author log linked from https://blog.majid.info/llama-bench/ (April 13, 2026 article). Measured hardware: AMD Ryzen AI 7 350 / Radeon 860M, 32GB system RAM. Gemma4 E4B Q4_K_M GGUF, llama.cpp 82764d8f4 (8770), backend ROCm. pp512 291.48 ±49.07 tokens/s; tg128 6.65 ±0.48 tokens/s. gfx1150; one device, ngl99; 15609 MiB runtime device VRAM visibility, not dedicated VRAM or resident memory. Command names --hf-repo unsloth/gemma-4-E4B-it-GGUF; exact tested quantization repository https://huggingface.co/unsloth/gemma-4-E4B-it-GGUF ; tested revision unknown. Log reports 4.62 GiB model size and 7.52B counted parameters; size is not resident memory. Context depth, KV quantization, measured power, driver version and explicit speculation/concurrency declarations unreported. Raw source: https://blog.majid.info/llama-bench/xhystos.txt .