llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · llama.cpp · 16,384 ctx

Tone: mixedAMD hardware
Oct 3, 2026
Throughput
20.0 t/s gen
Quant
GSQ-RCO (GGUF)
KV cache
Q4
System RAM
64 GB
VRAM reported
32 GB

Use cases

coding

Summary

User reports Qwen3.8 Flash-Next at 20 t/s generation on a Strix Halo 128GB laptop with 64GB RAM. Setup is llama.cpp via lemonade with Vulkan on Windows, GSQ-RCO GGUF quant, 16k context, Q4 KV cache, and lazy load enabled. The model uses about 30GB of GPU memory but also consumes roughly 20GB of CPU memory, which the user suspects is the n-gram table not staying on SSD. The user notes the model loaded and worked rather well, but a default prompt ran out of the 16k context due to extended thinking.