Qwen3.8 125B (6B active) Flash-Next
on 2× AMD Strix Halo 128GB · llama.cpp · 196,000 ctx
Summary
User reports 84 t/s with 4 streams at 196K context on a model split across an iGPU (Vulkan) and an RTX 3090 Ti (CUDA).
The model has 512 experts per layer, 36 layers of gated DeltaNet, 12 layers of top-k sparse attention, a 26.8 GiB n-gram table, and a built-in MTP draft head, at 103.69 GiB.
Baseline on the iGPU alone is 22.2 tok/s. HumanEval+ scores 155/164, against 156/164 for Qwen3.8-27B on dual 3090 vLLM.