Qwen3.8 125B (6B active) Flash-Next
on 2× AMD Radeon AI PRO R9700 32GB · Radiance · 200,000 ctx
Summary
User reports Qwen3.8-Flash-Next at approximately 140-155 tok/s on 2x Radeon AI PRO R9700, up from 31 tok/s on Windows.
Setup is the Radiance engine with FP8+IQ4R weights and MTP speculative decoding at 200K context.
The user also reports Qwen3.8-27B at about 42 tok/s on one R9700 with Vulkan and MTP, Ling 3.0 Tiny at about 183 tok/s on an RTX 5060 Ti 16GB with Q8_0, and Gemma 4 12B at about 90 tok/s on the same card with a QAT UD-Q4_K_XL build and an MTP drafter.