llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Ryzen AI Max+ 395 96GB · GSQHalo.cpp · 131,072 ctx

Tone: positive
Oct 3, 2026
Throughput
44.2 t/s gen · 1386.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_XXS (GGUF)
KV cache
f16
System RAM
96 GB

Summary

User reports Qwen3.8-Flash-Next at 1386 t/s prefill and 44.2 t/s decode on a 96GB GMKtec EVO-X2 (Ryzen AI Max+ 395). Setup is a fork of strix-llama.cpp called GSQHalo.cpp with GSQ-RCO IQ3_XXS GGUF quants, f16 KV cache, 128K context, MTP on, and KV cache stored on SSD. Without MTP the same run gives 1446-1457 t/s prefill and 24.3-24.5 t/s decode. Two 256K slots with MTP give 1067 t/s prefill on a 250K prompt and 14.1 + 16.6 t/s decode on both slots at once.