llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · llama.cpp · 131,072 ctx

Tone: mixedAMD hardware
Sep 11, 2026
Throughput
33.2 t/s gen · 1192.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
128 GB

Use cases

codinglong-context

Summary

User benchmarks five Strix Halo llama.cpp forks with Qwen3.8 Flash-Next on a Flow Z13 (Ryzen AI Max+ 395, 128 GB, gfx1151). halogen 0.5.4 at 70W reaches prefill 1192/1350/1315 t/s at 8k/32k/131k and decode 33.2 t/s serial and 43.1 t/s drafted. Nathan's toolbox v0.7.4.1 on Vulkan reaches 26 t/s serial and 34.3 t/s drafted, with prefill 539/433 t/s at 8k/32k. myhacsint reaches 25.7 t/s serial and 35.6 t/s drafted, with prefill 532/584/538/427 t/s. strix-llama was not run; the thread reports 14 t/s serial and prefill 532/397 t/s. Speculative decoding fails the byte-identity gate on every GGUF build tested, with 3/5 to 9/10 prompts differing at temp 0. Serial reruns are byte-identical 10/10. The halogen 0.5.3 changelog claims 1246/1424/1358 t/s prefill at 8k/32k/131k. The model is Qwen3.8 Flash-Next; parameter count is not stated.