Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · llama.cpp · 131,072 ctx
Summary
User reports 30 t/s decode and 120 t/s prefill on a dual GPU setup.
Setup is llama.cpp with a PR build.
User asks for optimization advice.
on 2× NVIDIA RTX 3090 · llama.cpp · 131,072 ctx