llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 5060 Ti 16GB · llama.cpp

Tone: mixedNVIDIA hardware
Nov 4, 2026
Throughput
15.0 t/s gen
Quant
Q4_K_XL (GGUF)
System RAM
96 GB

Summary

User reports Qwen3.8-Flash-Next Q4_K_XL (unsloth) at 15 t/s generation on dual RTX 5060 Ti 16GB cards. Setup is llama.cpp v0.8.0 with tensor parallel over PCIe 5.0 x8x8, no MTP, alongside 96GB of DDR5-6000 system RAM. The figure is offered as a hypothetical ("might run") rather than a measured benchmark, and the user says they stay on llama.cpp for quality despite the slower speed of newer engines.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Qwen3.8 125B · 6B active at 4-bit by hardware

Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Models most run on the NVIDIA RTX 5060 Ti 16GB

Bars are medians on one scale, 0 to 95.2 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the NVIDIA RTX 5060 Ti 16GB →Every Qwen3.8 report →Estimate Qwen3.8 on this card →