Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · llama.cpp · 262,144 ctx
Sep 11, 2026
Summary
User reports token generation improving from 20 t/s to 49 t/s with the flashnext-e06 fork on 2x RTX 3090, an Intel Ultra 7 270k Plus, and 192 GB DDR5@5600 MHz.
Setup uses an MTP draft model in Q8_0 and ngram-mod speculative decoding.
Prompt processing is faster on the main branch.