Gemma 4 12B
on NVIDIA RTX 5090 · vLLM
Sep 7, 2026
Summary
User benchmarks Gemma4-12B on an RTX 5090, comparing vLLM stock, vLLM+Emmy, and llama.cpp.
The runs report throughput and latency across various token lengths and concurrency levels.
The comparison also covers speculative decoding (MTP) tests and kernel optimization details.