llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX PRO 6000 Max-Q · SGLang

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
240.0 t/s gen
Quant
NVFP4
System RAM
128 GB
VRAM reported
96 GB

Summary

User reports Qwen3.8-Next-Flash at ~240 t/s decode on a single RTX Pro 6000 Max-Q at 300W. Setup is a patched sglang with the RadixArk/Qwen3.8-Flash-Next-NVFP4 checkpoint, using FP8 quantization of the lm head and layers, kernel tuning, and MTP config tuning. The user notes a theoretical bandwidth limit of ~280 t/s.