llamaperf

Gemma 4 8B E4B

on NVIDIA RTX 3060 12GB · LM Studio · 4,096 ctx

NVIDIA hardware
Nov 20, 2026
Throughput
74.0 t/s gen
Quant
Q4_K_M (GGUF)
VRAM reported
12 GB

Summary

User reports Gemma 4 E4B at 74 tok/s on an RTX 3060 12GB, measured with LM Studio (llama.cpp CUDA) at Q4_K_M with full GPU offload. VRAM use was 4.51 GB at 4K context, 4.72 GB at 16K and 5.01 GB at 32K. The user notes E4B is 8B parameters on paper but about 2.8B of that is per-layer embeddings llama.cpp keeps in system RAM. Qwen3.5 9B ran at 54 tok/s using 6.66 GB at 4K, 7.07 GB at 16K and 7.63 GB at 32K. Qwen3.8 27B did not fit, with 9.5 GB on GPU and the rest in RAM, at 5.4 tok/s. The user also built a browser-based VRAM calculator around these measurements.