Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3060 12GB · 131,072 ctx
Use cases
agentic
Summary
User reports Qwen3.8-Flash-Next at ~12 t/s on 2× RTX 3060 12GB at 131,072 context.
Setup is the AtomicChat AD-3.84bpw-IQ4_XS-M64 GGUF (~85GB) with CPU MoE offload, most expert weights partially offloaded to system RAM.
The goal was a quality-first local agent / batch worker rather than maximum chat latency; a 26.5k-token agent prompt was used.