llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 16,384 ctx

Tone: mixedAMD hardware
Nov 11, 2026
Throughput
34.1 t/s gen
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 34.1 tok/s decode on a Ryzen AI Max+ 395 128GB mini PC. Setup is Gufo at 16K context, with the model weights taking around 103.7 GiB. With MTP decode rises to 53.7 tok/s, and adding the NPU gives 34.2 tok/s decode with about 10% faster prefill. The user questions whether the largest model is the best use of the memory.