llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 4070 Ti Super · Strata · 131,072 ctx

Tone: positiveNVIDIA hardware
Oct 14, 2026
Throughput
45-53 t/s gen
Quant
Q2
System RAM
64 GB
VRAM reported
16 GB

Use cases

agenticvisioncreative-writing

Summary

User reports Qwen3.8 Flash-Next at roughly 45-53 output tokens per second on an RTX 4070 Ti SUPER 16GB. Setup is Strata with Q2 quantization and a 128K context configuration, running on a 16GB GPU with 64GB DDR4 DRAM. The complete workflow used multiple computers; the LLM ran on the 16GB GPU while modelling, image generation and other services were handled elsewhere. The user notes Windows was using 15 to 20 GB of the system RAM.