Qwen3.8 125B (6B active) Flash-Next
on 4× NVIDIA RTX 3060 12GB · llama.cpp
Sep 9, 2026
Use cases
general-conversation
Summary
User reports Qwen3.8 Flash Next at 27-29 t/s generation and 290-340 t/s prefill across 4 GPUs using 52 GB of VRAM.
Setup is the IQ2_M quant with context offloaded at Q8 and an n-gram cache on SSD.
User reports roughly 98% clean Finnish output, but notes safety guardrails cause freezes in grey areas.