Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3060 12GB · llama.cpp · 131,072 ctx
Sep 7, 2026
Summary
User reports a 125B MoE model with 6B active on 2x RTX 3060 12GB in llama.cpp, with prefill improving from 36 to 303 t/s and decode at 12 t/s.
Setup uses -sm layer and -ub 2048.
ik_llama.cpp was also tested at 407 t/s prefill but uses ~108GB RAM.