llamaperf

SenseNova-Loop 9B

on NVIDIA RTX 5090 Laptop 24GB

Tone: mixedNVIDIA hardware
Nov 18, 2026
Throughput
300-500 t/s gen
Quant
NVFP4 (NVFP4)

Use cases

tool-useagentic

Summary

User reports SenseNova-Loop-9B running at 300-500 tok/s on a laptop RTX 5090 in NVFP4. The model is a looped transformer with a small drafter, and the user says its architecture translates well to existing kernels. The user cannot yet confirm it holds up against Qwen3.8 27B NVFP4 and suspects their setup may be broken despite a calibration run; in their tool-eval-bench runs SNL-9B scored 92 vs 98 on the standard set and 73 vs 87 on hard mode, with 0 on tenant separation and policy application.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Models most run on the NVIDIA RTX 5090 Laptop 24GB

Bars are medians on one scale, 0 to 107.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.

Everything reported on the NVIDIA RTX 5090 Laptop 24GB →