Qwen3 30B (3B active)
on NVIDIA RTX 4060 Ti 16GB · KoboldCpp
Summary
User reports Qwen3-30B-A3B at 15 t/s on an RTX 4060 Ti 16GB using TensorTune's smart tensor offloading.
Setup is KoboldCpp with Q4_K_M quant, all layers on GPU with tensor offloading.
The baseline with traditional layer offloading (30 layers) was 10 t/s, a 50% improvement.