llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5060 Ti 16GB · Strata · 260,000 ctx

Tone: mixedNVIDIA hardware
Oct 16, 2026
Throughput
60.0 t/s gen
Quant
IQ3_S (GGUF)
KV cache
Q8
System RAM
110 GB
VRAM reported
16 GB

Use cases

codingagentictool-use

Summary

User reports Qwen3.8-Flash-Next IQ3_S at 60 t/s generation on an RTX 5060 Ti 16GB, running on Strata with system RAM overflow. Setup uses Q8 KV cache at 260k context, with the model overflowing to system RAM. The user also tested Qwen3.8 27B IQ3_S at 25-30 t/s with 120k context and Qwen3.8 27B IQ4_XS at 25-30 t/s with 80k context (100k without MTP). User recommends Flash-Next for coding and 27B for non-coding and SVG generation. Notes that Q8 KV cache produced better quality than Q4 in lm-eval benchmarks (73.5% vs 70% on 200 gsm8k samples).