Gemma 4 8B E4B

on NVIDIA RTX 3060 12GB · Ollama

May 1, 2026

Throughput

45.0 t/s gen

Quant

Q4_K_M (GGUF)

Use cases

text-generation

Summary

User reports about 45 t/s on an RTX 3060 12GB. The E4B model fits easily.