Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 3060 12GB · llama.cpp · 65,536 ctx
Sep 7, 2026
Summary
User reports Qwen 3.8 Flash Next at 12-15 t/s on an RTX 3060 12GB in a Thinkstation P520 with 256GB RAM, at 65k context.
Setup is llama.cpp server with the model offloaded to GPU at --n-gpu-layers 999 and MoE experts on CPU at --n-cpu-moe 48.
The user notes the model is slow and low context, but output quality is much better than the previous Qwen 3.6 35B A3B. Performance degrades significantly when the system is busy.