Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · llama.cpp · 131,072 ctx
Use cases
agentic
Summary
User reports a hybrid attention model (Gated DeltaNet plus sparse QSA) with a 51B n-gram embedding table, which llama-bench reports as 176.94B all-in.
Setup is a 3-part GGUF, 87 GiB on disk, built from llama.cpp PR #27742 with a crash fix, on the Vulkan (RADV) backend.
The model uses about 91 GB resident at 131k context and loads in about 45s. The KV cache must stay F16, as quantized KV asserts.