llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090 · Strata

Tone: positiveNVIDIA hardware
Oct 25, 2026
Throughput
164.6 t/s gen · 6000-6500 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S (GGUF)
System RAM
64 GB
VRAM reported
32 GB

Summary

User reports Qwen3.8 Flash-Next at 164.6 tok/s decode on an RTX 5090 32GB, with prefill of 6,000~6,500 tok/s. Setup is Strata with an IQ3_S GGUF quant, on a Ryzen 9 9950X3D system with 64GB DDR5. The user previously ran IQ3_XSS and switched to IQ3_S for more speed and quality. The prompt asked for a Minecraft-style Eiffel Tower, which the model built in detail.