llamaperf
Oct 24, 2026
Throughput
160.0 t/s gen

Summary

User reports Qwen3.8-Flash-Next at 160 tok/s single-stream on two Radeon AI PRO R9700 cards. Setup details, engine, quant and KV cache are not stated in the post. At 8 concurrent users the user reports 470-630 tok/s aggregate. The user made a quant of the model and posted benchmarks and dev notes, and is looking to compare notes with other R9700 users.