Qwen3.8 125B (6B active) Flash-Next
on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp
Use cases
rplong-context
Summary
User benchmarks Qwen3.8-Flash-Next on a dual AMD Radeon AI PRO R9700 32GB setup (Lenovo P620, Threadripper Pro 3945WX, 128GB DDR4).
Setup is llama.cpp with Unsloth UD-Q3_K_XL GGUF, -ncmoe 5, -ngl 49, tensor-split 1.10,0.90, and 3 MTP draft tokens.
llama.cpp achieves 17.6 t/s generation and 616.5 t/s prompt processing, compared to 147.2 t/s and 6618.1 t/s on radiance 1.4.0, and 79.1 t/s and 1455.4 t/s on Strata 0.1.42. User notes radiance's prompt processing is unreasonably fast and adds a prefill slope metric. All three are considered equivalent in output quality for the user's purposes.