llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Halogen · 262,144 ctx

Tone: positiveAMD hardware
Nov 10, 2026
Throughput
62-68 t/s gen · 1900-2100 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
FP4
System RAM
128 GB

Use cases

agenticcodingtool-uselong-context

Summary

User reports Qwen3.8 Flash-Next 125B FP4 decoding at 62-68 tok/s on a Strix Halo 128GB mini PC (Ryzen AI Max+ PRO 495) under real agent traffic. Setup is the Halogen engine with a ~54GB FP4 checkpoint plus a ~48GB n-gram table and MTP drafter, 262k context and 4 concurrent slots; cold 28k prefill ran at ~1.9-2.1k tok/s and prompt cache hit rate was 98-99.6%. MiniMax-M3.1-Flash (428B, 93GB IQ1_S/IQ2_XXS quant) loaded but decoded at about 1 tok/s because 31% of experts streamed from NVMe; GLM-5.3-Flash ran at ~21 tok/s and Qwen3-30B-A3B at 70-93 tok/s. The model scored 73.3/100 on the user's Godot agent benchmark.