llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Strata · 17,844 ctx

AMD hardware
Oct 9, 2026
Throughput
42.0 t/s gen · 887.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ4_XS (GGUF)
KV cache
int8
MTP (Multi-Token Prediction)
on
System RAM
128 GB
VRAM reported
64 GB

Summary

User reports Qwen3.8-Flash-Next at 42.0 t/s generation and 887 t/s prefill on a GMKtec EVO-X2 with AMD Ryzen AI Max+ 395 (Strix Halo, 128GB unified, 64GB GPU carve-out). Setup is Strata 0.1.40.2 (HIP/ROCm) with Unsloth UD-IQ4_XS GGUF, int8 KV cache, 32,768 resident KV tokens, --spec 4 with MTP enabled, and a fresh 17,844-token prompt generating 300 tokens. Single-machine community self-report, not independently reproduced; MTP/speculative decoding is on, so this is not a non-speculative baseline. Chip power was about 121 W (peaks 138 W) and GPU clock median 2.75 GHz.