Qwen3.8 125B (6B active) Flash-Next
on AMD Strix Halo 128GB · llama.cpp · 16,384 ctx
Use cases
coding
Summary
User reports Qwen3.8 Flash-Next at 20 t/s generation on a Strix Halo 128GB laptop with 64GB RAM.
Setup is llama.cpp via lemonade with Vulkan on Windows, GSQ-RCO GGUF quant, 16k context, Q4 KV cache, and lazy load enabled. The model uses about 30GB of GPU memory but also consumes roughly 20GB of CPU memory, which the user suspects is the n-gram table not staying on SSD.
The user notes the model loaded and worked rather well, but a default prompt ran out of the 16k context due to extended thinking.