Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 3060 12GB · llama.cpp · 200,000 ctx
Oct 2, 2026
Summary
User reports Qwen3.8 Flash-Next at 10 t/s decode and 150 t/s prefill on an RTX 3060 12GB with 128 GB RAM.
Setup is llama.cpp with IQ4_XS GGUF and q8_0 KV cache at 200k context, with 48 MoE layers offloaded to CPU.
The post is a general inference engineering guide; the figures come from the user's sample launch command for this model.