Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · llama.cpp
Sep 12, 2026
Use cases
agentic
Summary
User reports Qwen3.8 Flash-Next 177B-A6B at 38 t/s single stream on 2x RTX 3090 with an EPYC 7551 and 128 GB DDR4-2133.
Setup is llama.cpp with an IQ4_XS GGUF; experts live in system RAM with hot ones cached in VRAM.
Two parallel requests drop to about 4 t/s each. User asks whether a third RTX 3090 or a CPU upgrade would help more, and whether faster RAM matters.