Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5060 Ti 16GB · QwFN-hybrid · 16,384 ctx
Use cases
codingagentic
Summary
User reports Qwen3.8-Flash-Next 125B on an RTX 5060 Ti 16GB with about 620 tok/s prompt processing at 16K; decode is given only per workload, 26.4 tok/s code, 21.3 agent, 21.8 reasoning and 17.7 at 21K context, with no overall figure.
Setup is the author's QwFN-hybrid engine on one RTX 5060 Ti 16GB, the 76GB model's experts offloaded across VRAM, 32GB DDR5 system RAM and an NVMe SSD.
llama.cpp on the same machine prefilled at about 165 tok/s at 16K. The author replays workloads token by token against llama.cpp, and the current release passes 4/5 parity gates.