llamaperf

Qwen3.8 27B

on NVIDIA RTX 5060 Ti 16GB · LM Studio

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
50-60 t/s gen
Quant
Q4
VRAM reported
16 GB

Summary

User reports Qwen 3.8 27B at 50-60 t/s on two RTX 5060 Ti 16GB cards. Setup is LM Studio with Q4 quantization and MTP. A comparison to Qwen 3.6 gave 30 t/s with MTP, with an OS change from Windows to Linux. The user also downloaded NVFP4 but did not try it in vLLM.