Qwen3.8 125B (6B active) Flash-Next
AMD RX 9070 XT 16GB · Strata · 256,000 ctx
- generation:
- 70-75 tokens/s
- quant:
- IQ3_S (GGUF)
User asks which quant to settle on for Qwen3.8 Flash-Next run with Strata on an RX 9070 XT with 64GB DDR5 and a 9800X3D, all at 256k context. ISTA IQ3_S runs at ~70-75 tokens/s, Unsloth UD-IQ3_XSS (3.1) at ~60-65 tokens/s and Unsloth UD-IQ4_XS (3.1) at ~40-50 tokens/s. User notices no substantial quality difference between the three and questions whether the ~40% speed penalty of UD-IQ4_XS over IQ3_S is worth it.