llamaperf
Sep 13, 2026
Throughput
28.0 t/s gen
Quant
3
System RAM
256 GB

Use cases

codingagenticlong-context

Summary

User reports GLM-5.3 Flash at around 28 t/s across four RTX 3090s at a quant of 3. Setup is four RTX 3090 24 GB cards on a Threadripper PRO 3975WX with 256 GB RAM, PCIe only, no NVLink. The user is planning a Qwen 3.8 Flash Next or Qwen 3.8 27B setup and asks for advice on model and hardware configuration.