llamaperf
Oct 21, 2026
Throughput
40-45 t/s gen
Quant
Q2
System RAM
32 GB
VRAM reported
16 GB

Summary

User reports Qwen3.8 Flash-Next at around 40-45 tok/s on an RX 6900 XT 16GB, depending on the prompt. Setup is Strata with a Q2 quant on a 32GB DDR4 system (Ryzen 7 5700X, B450 board). User asks whether to upgrade to 64GB RAM with an X570 board or add a second 6800/6900 XT for 16GB more VRAM, noting the current board's second slot is PCIe 2.0 x4. A dual-GPU goal would be Qwen3.8 27B at Q4 or higher.