llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX Pro 6000 Blackwell · vLLM · 173,400 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
110.0 t/s gen
Quant
NVFP4 (safetensors)
MTP (Multi-Token Prediction)
on
System RAM
64 GB
VRAM reported
96 GB

Use cases

codingtool-usevisionagentic

Summary

User reports Qwen3.8-Flash-Next at roughly 110 t/s, ranging from 76 to 125 t/s, on a single RTX Pro 6000 Blackwell with 96 GB, at 165,000 to 170,000 tokens of context. Setup is vLLM with the NVFP4 quant and INT4 quantized PLE n-grams, MTP speculative decoding, prefix caching, and PLE CPU offload. The user praises quality for coding and agentic tasks.