llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3060 12GB · Strata

Tone: positiveNVIDIA hardware
Oct 16, 2026
Throughput
60.0 t/s gen
Quant
IQ3_S (GGUF)

Use cases

coding

Summary

User reports Qwen3.8 Flash-Next at 60 t/s average code generation on empty context, with peaks of 60-70 t/s, on two RTX 3060s. Setup is Strata with IQ3_S weights and MTP speculation enabled; the user tuned --pcie-frac to 0.2, --pool-workers, --trim-stage-weights, --pipeline-windows 6, and forced GPU 1 (the faster PCIe lane) as the main GPU via gpu_order as_given. The user says the previous baseline was about 35 t/s decode peak, and that performance degrades with full context but still holds a solid +15-20% over the old baseline.