llamaperf
Sep 9, 2026
Throughput
51.9 t/s gen · 322.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
VRAM reported
24 GB

Summary

User reports a 36% improvement in generation speed with a dual GPU setup of an RX 7900 GRE 16GB and an RX 480 8GB. The user tested medgemma-27b-it-UD-Q6_K_XL, Qwen3.8-27B-Q6_K, Qwen3.8-27B-OBLITERATED-Q5_K_M, and Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced-Q4_K_M, with and without Flash Attention.