Qwen3.8 125B (6B active) Flash-Next
on Unknown GPU · Strata · 42,000 ctx
Summary
User reports Qwen3.8 Flash-Next at about 30 t/s average on an 8GB GPU, with peaks up to 48 t/s.
Setup is Strata on CachyOS with a 3-bit Unsloth quant, running at 42k context; 32k works fine and 42k leaves about 130MB of VRAM headroom.
The same model ran at 9 t/s before switching to Strata, and the user says 64k context does not fit in VRAM.