llamaperf

Qwen3 30B (3B active)

on NVIDIA RTX 4060 Ti 16GB · KoboldCpp

Tone: positiveNVIDIA hardware
Sep 28, 2026
Throughput
15.0 t/s gen
Quant
Q4_K_M (GGUF)
VRAM reported
16 GB

Summary

User reports Qwen3-30B-A3B at 15 t/s on an RTX 4060 Ti 16GB using TensorTune's smart tensor offloading. Setup is KoboldCpp with Q4_K_M quant, all layers on GPU with tensor offloading. The baseline with traditional layer offloading (30 layers) was 10 t/s, a 50% improvement.