Qwen 3.8-Flash-Next / IQ4_NL-PROJFIX / fresh-server 131072 ctx
on AMD Strix Halo 128GB · llama.cpp d67d5883 / custom ROCm (rocm-systems 7dda3ac6) · 131,072 ctx
Summary
User reports Qwen3.8-Flash-Next at 31.7 t/s generation and 935 t/s prompt processing on a single Radeon 8060S gfx1151 in an AMD Ryzen AI MAX+ 395 with 128 GB unified memory.
Setup is llama.cpp with IQ4_NL-PROJFIX and a shared Q8_0 MTP sidecar, FP16 KV cache, one slot, batch/microbatch 16384, MTP width 3, at 131072 tokens of context.
The 131072-token run used 122869 input and 512 output tokens with 131.48 s TTFT; the source also lists 196608- and 262144-token runs at 29.09 and 28.49 t/s.