llamaperf

Qwen3.5 9B

on NVIDIA RTX 5090

NVIDIA hardware
Sep 7, 2026
VRAM reported
32 GB

Summary

User benchmarks Qwen3.5-9B, NVIDIA-Nemotron-3.5-Lightning-30B-A3B and Gemma-4-12B-it on a single RTX 5090. Nemotron-3.5-Lightning-30B-A3B runs as a UD-Q4_K_XL GGUF and Gemma-4-12B-it as QAT w4a16. Qwen3.5-9B scores 0.717 on GPQA Diamond and 0.713 on LiveCodeBench.