Qwen3.8 125B (6B active) Flash-Next
AMD RX 6900 XT 16GB · Strata · 65,536 ctx
- generation:
- 41.5 tokens/s
- quant:
- Q2_0 (GGUF)
- kv:
- Q8
User reports Qwen3.8 Flash-Next at 41.5 t/s on an RX 6900 XT 16GB, generating a roughly 4500-token animated SVG response; a Python task ran at about 32 tok/s. Setup is Strata with Q2_0 weights, 64k context and Q8 KV cache, using around 13.2GB VRAM on a Ryzen 7 5700X with 32GB DDR4 3600. The user has not filled the 64k context yet and wonders whether Q4 KV would allow more; the plan is 64GB RAM with IQ3_S, and IQ3_XXS is also being considered.