llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · strixite · 87,000 ctx

Tone: positiveAMD hardware
Oct 14, 2026
Throughput
90.2 t/s gen · 1375.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 90.2 t/s decode and 1375 t/s prefill on a Strix Halo 128GB at 87k tokens of context. Setup is the strixite engine with cold, cache-defeated runs; the model is a hybrid recurrent/attention architecture whose KV cache is about 20 GiB at full depth. Decode decays from 94.6 t/s at 21k to 90.0 t/s at 261k, a 10% cost across 50x the memory. The user retracted earlier 765k t/s prefill figures as prefix-cache hits and reports the box runs 176.9B parameters at full working depth.