Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · llama.cpp
Use cases
coding
Summary
User reports Qwen3.8-Flash-Next at 47.1 t/s on an AMD Strix Halo 128GB, up from 16.8 t/s baseline, for file rewrite at about 8k context.
Setup is llama.cpp on ROCm 7.1 with the UD-IQ4_XS GGUF, using GPU TOP_K improvements, native MTP speculative decoding and ngram-mod augmentation.
New code at 8k context reached 31.7 t/s; at about 24k context, file rewrite reached 28.6 t/s and new code 25.4 t/s, against baselines of about 15 t/s.