llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · llama.cpp · 256,000 ctx

Tone: positiveAMD hardware
Sep 11, 2026
Throughput
10-15 t/s gen
Quant
UD-Q4_K_XL (GGUF)
MTP (Multi-Token Prediction)
on
Rating
5/5
System RAM
128 GB

Use cases

codingagenticlong-context

Summary

User compares Qwen 3.8 27B at Q6_K and about 31 GiB resident against Qwen 3.8 Flash Next at UD-Q4_K_XL and about 86 GiB on an ASUS ROG Flow Z13 with Ryzen AI Max+ 395, 128 GB unified memory, running Arch Linux. Decode is 10-15 tok/s. Setup is the llama.cpp backend with the LlamaStash tool and the Pi coding harness. Cold prefill runs 31k tokens in 3 min (about 172 t/s) and a 128k window in about 18 min (about 118 t/s). Warm follow-up turns take about 45s. MTP gives 7.3 to 22.4 tok/s on an empty window and 1.15x at the full 256k. Flash Next completes the same 5/5 coding tasks with 45% fewer tokens, 76.5s against 289.8s for 27B. On the Artificial Analysis index Flash Next scores 40 against Opus 4.8 at 42, and 27B xhigh scores 34 against Opus 4.6 at 32. Thinking is 90-95% of generated tokens. The setup costs $0/month and runs fully offline.