Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5090 · llama.cpp · 64,768 ctx
Sep 24, 2026
Summary
User reports Qwen3.8 Flash-Next at 40 t/s decode on an RTX 5090 with 64GB system RAM.
Setup is llama.cpp with the Atomic Q4_K_M GGUF at 64,768 context, using mmap, lazy mode, flash attention, all GPU layers, and 32 MoE layers offloaded to CPU. The run used 27GB of VRAM and 8GB of system RAM.
User notes the prompt processing figure of 50 t/s is likely inaccurate due to the short prompt, and questions why the model is not buffering more into system RAM instead of reading from the NVMe drive.