llamaperf

Qwen3 30B (3B active)

on NVIDIA RTX 5060 Ti 16GB

Tone: positiveNVIDIA hardware
Jul 11, 2026
Throughput
50-54 t/s gen
Quant
float8
VRAM reported
16 GB

Summary

User reports 50-54 t/s with a custom CUDA/C++ engine, a 50% improvement over llama.cpp at 33-34 t/s.