SenseNova-Loop 9B
Use cases
tool-useagentic
Summary
User reports SenseNova-Loop-9B running at 300-500 tok/s on a laptop RTX 5090 in NVFP4.
The model is a looped transformer with a small drafter, and the user says its architecture translates well to existing kernels.
The user cannot yet confirm it holds up against Qwen3.8 27B NVFP4 and suspects their setup may be broken despite a calibration run; in their tool-eval-bench runs SNL-9B scored 92 vs 98 on the standard set and 73 vs 87 on hard mode, with 0 on tenant separation and policy application.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Models most run on the NVIDIA RTX 5090 Laptop 24GB
- Qwen3.8 27B4-bit33.5 t/s · 2 runs
- Qwen3 14B4-bit3.6 t/s · one run
- 107.0 t/s · one run
Bars are medians on one scale, 0 to 107.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.