Gemma 4 8B E4B

User reports Gemma 4 E4B-it at 51.65 tok/s decode on an RTX 3050 8GB laptop, compared to 45.20 tok/s with llama.cpp on the same machine and GGUF file. Setup is SonicBoom, a C++/CUDA runtime, with Q3_K_M quant and greedy sampling. The decode lead comes from a graph compiler that fuses quantization and captures each step as a CUDA Graph; the quantized matmul kernels are ported from ggml. Prefill is about half of llama.cpp at 1051 tok/s versus ~1944 tok/s. Decode at depth 2048 is 47.13 tok/s. TTFT for a 4000-token prefix plus 100 new tokens is 503 ms with prefix reuse. Only sm_86 is tested and only Q3_K, Q4_K and Q5_K formats load.