llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Kyojin · 4,096 ctx

Tone: positiveAMD hardware
Oct 8, 2026
Throughput
32.7 t/s gen · 1412.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
EXL3 (EXL3)
System RAM
128 GB

Use cases

codingagenticlong-context

Summary

User (Yamz Labs) reports Qwen3.8-Flash-Next at 32.7 tok/s decode without speculative decoding and 1,412 tok/s prefill at 4K on a single Strix Halo mini PC with their Kyojin engine. Setup is a single AMD Ryzen AI Max+ 395 with 128GB unified memory, 95GB EXL3 weights, Kyojin on ExLlamaV3, plain decoding with no speculation. With speculative decoding decode reaches 44 to 59 tok/s depending on the task (chat ~47, code ~58, copy-heavy edits ~60). Prefill stays near flat at 1,486 tok/s at 32K and 1,367 at 128K. The authors say Halogen 0.16.2 is faster at 39.8 tok/s plain.