llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 4080 · Strata

Tone: mixedNVIDIA hardware
Oct 7, 2026
Throughput
55.0 t/s gen · 590.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q3
KV cache
Q8
System RAM
128 GB

Summary

User reports Qwen3.8 Flash-Next at 55 t/s on an RTX 4080 with 128 GB DDR5 RAM, using Strata with Q3 weights and Q8 KV cache at roughly 120-150k context. Setup is Strata with the 3060 left unused; adding the second GPU drops generation to 45 t/s and prompt processing to 250 t/s from 590 t/s. With Unsloth Studio the same model reached 27 t/s on the 4080 alone, 23 t/s with both GPUs, and 16 t/s with both GPUs on an older PCIe 4.0 x1 link. The user asks whether the 3060 is counter-productive alongside the 4080.