Qwen3.8 125B (6B active) Flash-Next
on Ryzen AI Max+ 395 96GB · GSQHalo.cpp · 131,072 ctx
Summary
User reports Qwen3.8-Flash-Next at 1386 t/s prefill and 44.2 t/s decode on a 96GB GMKtec EVO-X2 (Ryzen AI Max+ 395).
Setup is a fork of strix-llama.cpp called GSQHalo.cpp with GSQ-RCO IQ3_XXS GGUF quants, f16 KV cache, 128K context, MTP on, and KV cache stored on SSD.
Without MTP the same run gives 1446-1457 t/s prefill and 24.3-24.5 t/s decode. Two 256K slots with MTP give 1067 t/s prefill on a 250K prompt and 14.1 + 16.6 t/s decode on both slots at once.