Gemma 4 12B
on Unknown GPU · llama.cpp · 32,768 ctx
Use cases
coding
Summary
User reports a switch from Q4_K_XL at 61 t/s to Q5_K_XL at 50 t/s for better syntax accuracy.
The model file is about 8.6 GB, with total VRAM usage around 15.7 GB at 32k context and a Q8 KV cache.
The user finds it compares favorably to Qwen 3.6 27B and 35B A3B for ease of use and tool call compatibility.