llamaperf
Oct 8, 2026
Throughput
50.0 t/s gen
System RAM
96 GB

Use cases

coding

Summary

User reports approximately 50 TPS on Qwen3.8 Flash Next on an RTX 5090 with 96GB DDR5. Setup is a single RTX 5090 with 96GB DDR5 system RAM, with part of the 125B model in system RAM since it cannot fit in 32GB of VRAM. The user also gets 200+ TPS on Qwen3.8 27B on the same card. No engine or quant is stated, and the post asks which model sits between the two for coding.