llamaperf

Gemma 4 8B E4B

on AMD RX 7900 XTX · vLLM

AMD hardware
May 2, 2026
Throughput
58.0 t/s gen · 83.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
FP16 (safetensors)

Use cases

text-generation

Summary

User reports Gemma 4 E4B at 57.96 gen tok/s and 82.96 prompt tok/s on an RX 7900 XTX. Setup is vLLM with ROCm on the default path. Source is flexinfer.ai.