Qwen3.8 125B (6B active) Swift-1.5
on NVIDIA RTX 3060 Ti 8GB · Strata · 128,000 ctx
Oct 16, 2026
Summary
User reports running Swift-1.5-Qwen3.8-Flash-Next at IQ2_XS on an RTX 3060 Ti 8GB with 32GB system RAM, getting 18 t/s generation at 128k context.
Setup is Strata with IQ2_XS quant, int8 KV cache, and expert offloading to system RAM. Prefill is 27 t/s with MTP enabled (334 experts cached in GPU) and 33 t/s with MTP off (1027 experts cached in GPU).
User is happy with generation speed given the low VRAM but is struggling with prefill performance and is asking for suggestions.