llamaperf

Qwen3.8 125B (6B active) Flash-Next Uncensored

on NVIDIA V100 32GB · Strata · 262,144 ctx

Tone: positiveNVIDIA hardware
Oct 4, 2026
Throughput
50-55 t/s gen · 850-900 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
KV cache
fp16
System RAM
128 GB
VRAM reported
32 GB

Use cases

agenticcreative-writingmultilingual

Summary

User reports Qwen3.8-Flash-Next Uncensored at 50-55 t/s decode and 850-900 t/s prefill on a Tesla V100 32GB, with general tasks at 40-45 t/s. Setup is Strata with IQ4_XS and fp16 KV cache at 262K context, single card with 180W power cap. User also ran Qwen3.8-Flash-Next IQ3_S on an RTX 3090 at 60-65 t/s decode and 1200-1300 t/s prefill, and notes the uncensored IQ4_XS variant handles non-English writing better.