llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3080 10GB · Speedy · 200,000 ctx

Tone: positiveNVIDIA hardware
Nov 10, 2026
Throughput
145-185 t/s gen · 3957.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
UD-IQ4_XS (GGUF)
System RAM
128 GB
VRAM reported
10 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-Flash-Next on 2x RTX 3080 10GB with experts in system RAM, reaching 3,957 t/s prefill at a 200K cold prompt and decode of ~145-185 t/s with UD-IQ4_XS. Setup is the Speedy fork of Strata with UD-IQ4_XS, a 200K-token cold prompt, two pipeline windows and speculative decoding; the box is a Threadripper PRO 5975WX with 128 GB DDR4-3200. Decode varies with reply length and context, sitting at the top of the range for short replies and the bottom after a 200K prompt; a 200K cold prompt took 51 s. The 1x RTX 3080 table gives ~113-128 t/s decode and 1,792 t/s prefill at 200K for the same quant.