llamaperf

Minimax M3 428B (23B active) uncensored

on 4× NVIDIA RTX Pro 6000 Blackwell · SGLang · 32,768 ctx

NVIDIA hardware
Oct 9, 2026
Throughput
88.5 t/s gen
Quant
NVFP4 (safetensors)
KV cache
BF16
VRAM reported
96 GB

Use cases

tool-usevisionlong-contextagentic

Summary

User reports MiniMax-M3-uncensored-NVFP4 at about 88.5 tokens/s for a warmed-up single-request decode on 4x NVIDIA RTX PRO 6000 Blackwell 96 GB. Setup is SGLang with ModelOpt NVFP4 routed-expert weights, BF16 KV cache, tensor parallel size 4, 32,768-token configured context, CUDA graph enabled, and two concurrent requests allowed. The figure is a measured short-request decode rate after warmup; the checkpoint was compressed from 854.2 GB BF16 to 260.4 GB. Long-context probe recalled a sentinel from a 20,212-token prompt, and vLLM was not accepted for this deployment.