llamaperf

Qwen3.8 125B (6B active) Swift-1.5

on NVIDIA RTX 3060 Ti 8GB · Strata · 128,000 ctx

Tone: mixedNVIDIA hardware
Oct 16, 2026
Throughput
18.0 t/s gen
Quant
IQ2_XS (GGUF)
KV cache
int8
System RAM
32 GB
VRAM reported
8 GB

Summary

User reports running Swift-1.5-Qwen3.8-Flash-Next at IQ2_XS on an RTX 3060 Ti 8GB with 32GB system RAM, getting 18 t/s generation at 128k context. Setup is Strata with IQ2_XS quant, int8 KV cache, and expert offloading to system RAM. Prefill is 27 t/s with MTP enabled (334 experts cached in GPU) and 33 t/s with MTP off (1027 experts cached in GPU). User is happy with generation speed given the low VRAM but is struggling with prefill performance and is asking for suggestions.