Qwen3.8 125B (6B active) Flash-Next
NVIDIA RTX 5060 Laptop 8GB · Strata · 262,144 ctx
- generation:
- 30-40 tokens/s
- prompt processing (prefill):
- 800-970 tokens/s
- quant:
- TQ1_0 (GGUF)
User reports running Qwen3.8 Flash-Next (125B-A6B) with the Gyro S TQ1_0 GGUF on an RTX 5060 Laptop with 8 GB VRAM and 32 GB RAM, getting PP 800-970 t/s and TG 30-40 t/s at 262K context with the Chat configuration. Setup is Strata with experts mmapped to SSD, KV cache split between VRAM and RAM, and Vision run on the CPU; MTP is disabled. At 131K context the Chat configuration gives PP 930-1,040 t/s and TG 30-45 t/s, while the Agentic configuration gives PP 520-740 t/s and TG 30-40 t/s at 262K and PP 670-890 t/s and TG 30-45 t/s at 131K. The user compares this with Qwen 3.6 35B A3B in llama.cpp at PP 630-680 t/s and TG 27-35 t/s, and says the model replaced all their coding agents.