llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5060 Laptop 8GB · Strata · 262,144 ctx

Tone: positiveNVIDIA hardware
Oct 26, 2026
Throughput
30-40 t/s gen · 800-970 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
TQ1_0 (GGUF)
System RAM
32 GB
VRAM reported
8 GB

Use cases

codingagenticvision

Summary

User reports running Qwen3.8 Flash-Next (125B-A6B) with the Gyro S TQ1_0 GGUF on an RTX 5060 Laptop with 8 GB VRAM and 32 GB RAM, getting PP 800-970 t/s and TG 30-40 t/s at 262K context with the Chat configuration. Setup is Strata with experts mmapped to SSD, KV cache split between VRAM and RAM, and Vision run on the CPU; MTP is disabled. At 131K context the Chat configuration gives PP 930-1,040 t/s and TG 30-45 t/s, while the Agentic configuration gives PP 520-740 t/s and TG 30-40 t/s at 262K and PP 670-890 t/s and TG 30-45 t/s at 131K. The user compares this with Qwen 3.6 35B A3B in llama.cpp at PP 630-680 t/s and TG 27-35 t/s, and says the model replaced all their coding agents.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the NVIDIA RTX 5060 Laptop 8GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →