llamaperf

Qwen3.8 Next

on NVIDIA RTX 4070 Ti Super · Strata · 10,000 ctx

Tone: positive
Oct 7, 2026
Throughput
197.0 t/s gen · 3300.0 t/s pp
Quant
Q2 (GGUF)
System RAM
64 GB
VRAM reported
16 GB

Summary

User reports Qwen3.8 Next at 197 t/s generation and 3,300 t/s prefill on an RTX 4070 Ti Super 16GB. Setup is Strata on CachyOS with Q2 weights, 10k and 20k token prompts, 15.6GB VRAM plus 44GB system RAM used. An IQ3XXS run reached 120 t/s generation and 3,000 t/s prefill with 50GB system RAM used; total system power was 350W.