Gemma 4 8B E4B
on NVIDIA DGX Spark · llama.cpp
Summary
User reports 59.42 t/s generation and 3633.84 t/s prompt processing.
Source evidence (verbatim):
Source: https://blog.majid.info/llama-bench/dgx1.txt
# NVIDIA DGX Spark 128GB / GB10: original Gemma4 E4B Q4_K_M llama-bench log
First-hand author log linked from https://blog.majid.info/llama-bench/ (April 13, 2026 article). Measured hardware: NVIDIA DGX Spark 128GB / GB10. Gemma4 E4B Q4_K_M GGUF, llama.cpp ff5ef8278 (8763), backend CUDA. pp512 3633.84 ±201.59 tokens/s; tg128 59.42 ±0.96 tokens/s. One GB10, ngl99; 122502 MiB runtime device VRAM visibility. 128GB is unified system capacity, not dedicated VRAM or resident use. Command names --hf-repo unsloth/gemma-4-E4B-it-GGUF; exact tested quantization repository https://huggingface.co/unsloth/gemma-4-E4B-it-GGUF ; tested revision unknown. Log reports 4.62 GiB model size and 7.52B counted parameters; size is not resident memory. Context depth, KV quantization, measured power, driver version and explicit speculation/concurrency declarations unreported. Raw source: https://blog.majid.info/llama-bench/dgx1.txt .