Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3060 Ti 8GB · Strata · 128,000 ctx

Oct 14, 2026

Throughput

27.0 t/s gen · 475.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

IQ3_XXS (GGUF)

System RAM

50 GB

VRAM reported

8 GB

Summary

User reports Qwen3.8-Flash-Next IQ3_XXS at ~27 tok/s decode and ~475 tok/s prefill on an RTX 3060 Ti 8GB. Setup is Strata 0.1.44 on CachyOS with 128K context, running on an i7-4930K with 50 GB DDR3; the model is partially offloaded to system RAM. About 7 s to first token per turn. A second GPU (RTX 2080 Ti) is planned but not yet installed.

View source ↗