llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3060 12GB · Strata

Tone: positiveNVIDIA hardware
Nov 10, 2026
Throughput
33.0 t/s gen · 109.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
IQ2_XS (GGUF)
VRAM reported
12 GB

Summary

User benchmarks Qwen3.8-Flash-Next IQ2_XS on an RTX 3060 12GB, reporting 33.0 tok/s generation and 109 tok/s prompt processing in Strata versus 25.6 tok/s and 31 tok/s in llama.cpp. Setup is Strata against llama.cpp with the same prompt and a 128-token reply, six warm runs each on a Ryzen 7600X machine. Generation ranged 29.3–35.8 tok/s for Strata and 23.2–26.9 for llama.cpp, about 29% faster. Over 9,180 WikiText-2 tokens perplexity was 2.9212 versus 2.9156, with 96.78% same most-likely next token and mean KLD 0.0098.