Qwen3.8 125B (6B active) Flash-Next
on 2× NVIDIA RTX 3090 · Strata · 262,144 ctx
Use cases
coding
Summary
User reports about 30 t/s with IQ4_XS on two RTX 3090s running Strata, and around 100 t/s with IQ3_S and 20 t/s or less with Q4_K_XL.
Setup is Strata in Docker with 256K context, q4_0 KV cache, both GPUs, and 128GB of system RAM on a Ryzen 9 3900X.
The user is tuning the configuration for coding and asks whether the larger IQ4_XS quant is worth the speed drop over IQ3_S.