Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5070 Ti · llama.cpp
Aug 28, 2026
Summary
User reports Qwen3.8-Flash-Next at 26t/s on an RTX 5070 Ti 16GB with 64GB of DDR5 6000MHz system RAM.
Setup is llama.cpp with the IQ3_XSS quant, using mmap to fit the model into 16G of VRAM plus 64G of RAM, on a 9800X3D CPU.
The user says this is faster than a non-MoE 30B model, which only reaches 10 t/s.