Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5080 · llama.cpp · 10,000 ctx
Sep 7, 2026
Summary
User reports Qwen3.8-Flash-Next at 6 t/s on an RTX 5080 16GB with 64GB RAM, and finds it unusable.
Setup is llama.cpp with offloading to CPU/RAM. The first attempt used the IQ3_XXS quant, the second the Q4_K_M quant at 4.27bpw AD.