Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · 220,000 ctx
Summary
User reports Qwen3.8 Flash-Next at 80 t/s in real world scenarios on dual RTX 3090s.
Setup uses the W4A16-FP8PLE quant with context reduced to 220k and hot experts increased to 88 for max speed.
User also reports 2k+ prefill.