Qwen3.8 125B (6B active) Flash-Next
on AMD Radeon AI PRO R9700 32GB · llama.cpp · 131,072 ctx
Oct 5, 2026
Use cases
agentictool-usecoding
Summary
User reports Qwen3.8-Flash-Next at ~36 tok/s single stream on a single Radeon AI PRO R9700 32GB with 64GB system RAM.
Setup is llama.cpp with stew675's RDNA4 patches (r30), AtomicChat Q4_K_M quant, q8_0 KV cache, flash attention, 2 slots x 131k context, -ncmoe 41 and MOE_EXPERT_CACHE_MIB=4096, GPU capped at 220W.
Two streams combined reach ~50 tok/s and prompt reading is 526-589 tok/s. The 27B Q5_K_XL is ~1.7x faster per turn and reads prompts 1.6-2x as fast, but scores lower on tool-eval-bench Hard Mode (79.8 vs 93.9).