Qwen3.8 125B (6B active) Flash-Next
on NVIDIA RTX 5060 Laptop 8GB · Strata · 262,144 ctx
Use cases
codingagenticvision
Summary
User reports running Qwen3.8 Flash-Next (125B-A6B) with the Gyro S TQ1_0 GGUF on an RTX 5060 Laptop with 8 GB VRAM and 32 GB RAM, getting PP 800-970 t/s and TG 30-40 t/s at 262K context with the Chat configuration.
Setup is Strata with experts mmapped to SSD, KV cache split between VRAM and RAM, and Vision run on the CPU; MTP is disabled.
At 131K context the Chat configuration gives PP 930-1,040 t/s and TG 30-45 t/s, while the Agentic configuration gives PP 520-740 t/s and TG 30-40 t/s at 262K and PP 670-890 t/s and TG 30-45 t/s at 131K. The user compares this with Qwen 3.6 35B A3B in llama.cpp at PP 630-680 t/s and TG 27-35 t/s, and says the model replaced all their coding agents.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the NVIDIA RTX 5060 Laptop 8GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →