llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 3090 · Strata · 256,000 ctx

NVIDIA hardware
Oct 14, 2026
Throughput
62.0 t/s gen · 1400.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S GSQ-RCO (GGUF)
KV cache
INT8
VRAM reported
24 GB

Summary

User reports Qwen3.8 Flash-Next at ~62 t/s decode and ~1400 t/s prefill on a single RTX 3090 with 8-channel DDR4 server RAM. Setup is Strata with IQ3_S GSQ-RCO quant and 256K INT8 KV context at a 220W power cap. User also mentions GLM 5.3 Flash "Maya L" 156.3GB running on a single Tesla V100 32GB via Project Maya, but gives no throughput figure for it. User asks what benchmarks to use to compare the two models on quality.