llamaperf
Sep 7, 2026
Throughput
16.0 t/s gen
Quant
Q4_K_XS (GGUF)
System RAM
64 GB
VRAM reported
32 GB

Summary

User asks about adding RAM to run a larger quant of Qwen 3.8. User mentions Q4_K_XS ran fine at 16 tps.