llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× GTX 1080 + GTX 1060 · Strata · 131,072 ctx

Tone: positive
Oct 14, 2026
Throughput
25.0 t/s gen · 82.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_XXS (GGUF)
System RAM
64 GB

Summary

User reports Qwen3.8 Flash at about 25 t/s generation and 82 t/s prompt processing on a GTX 1080 plus GTX 1060 with 64GB DDR5. Setup is Strata with an IQ3_XXS GGUF at 131k context. The user says they did not expect such good results for hardware not made for this.