llamaperf

Qwen3.8 27B

on NVIDIA RTX Pro 4000 Blackwell SFF · 8,000 ctx

NVIDIA hardware
Oct 25, 2026
Throughput
58.5 t/s gen
VRAM reported
24 GB

Summary

User reports Qwen3.8 27B generation rising from 35.04 to 58.53 tok/s (+67%) on one RTX PRO 4000 Blackwell SFF after raising the power limit from 70 W to 120 W with VRAM +20% and core +180 MHz offsets. Setup used a modified VBIOS loaded into memory via a patched loader and NVIDIA open kernel modules, with no EEPROM flash; headline comparisons used 8,000 input tokens with ECC off. Only 1-3 requests per configuration across 158 total, and the 70 W baseline used the same modified VBIOS rather than factory firmware. Pushing VRAM from +20% to +33.3% slightly reduced 27B generation, 57.70 to 56.91 tok/s. Qwen3.6 35B A3B was almost flat between 106 and 120 W.