llamaperf
Sep 7, 2026
Throughput
20.0 t/s gen
Quant
Q4_K_M (GGUF)
VRAM reported
20 GB

Summary

User asks which GPU to buy to run Qwen 3.8 27B Q4_K_M at over 20 t/s. Options under consideration are an RTX 3080 20GB, an AMD Mi50 32GB, and a modified 2080 Ti 22GB. No benchmark results yet.