llamaperf
Sep 14, 2026
Throughput
100.0 t/s gen
Quant
IQ4_XS (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8 Flash Next at ~100 t/s generation on 2x Radeon AI PRO R9700 with 128GB system RAM. Setup uses the R9V engine with an IQ4_XS GGUF and n-gram SSD streaming, which the user says fixed crashes after ~12 hours of torture testing. Q4_K_XL is now supported at 50 t/s generation but the user notes it still needs fine tuning.