llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Halogen · 262,000 ctx

Tone: positiveAMD hardware
Oct 8, 2026
Throughput
64.0 t/s gen · 1500.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Use cases

codingagenticlong-context

Summary

User reports Qwen3.8 Flash-Next 125B MoE decoding at 64 tok/s and prefilling ~1,500 tok/s on a Strix Halo tablet, with the NPU handling search, dup scan, decisions and screening. Setup is the Halogen engine with 262k context, fully local; the GPU still does the thinking and the NPU changed what tokens got spent on, at ~7% iGPU cost when they overlap. First token lands in ~0.03s, about 43x faster than a cloud call measured side by side and still 7x with a second agent hammering the server; a 194k session compacted in ~50s versus 166 on the main model with 97% cache hit.