Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5090 · ik_llama.cpp
Use cases
codingagenticreasoning
Summary
User reports Qwen 3.8 Flash/Next 125B MoE at about 38.8 t/s decode and about 200 t/s prefill on an RTX 5090 with 64 GB of system RAM.
Setup is ik_llama.cpp with the AP quant at Q4_K_M, using about 29.7 GiB of VRAM.
User notes the run is slower and depends on system RAM bandwidth and CPU offload, and adds that Qwen 3.8 27B is extremely fast but weaker. User asks for advice on models and optimizations.