- throughput:
- 45.0 t/s gen
- quant:
- Q4_K_M (gguf)
text-generation
~40-50 tok/s on RTX 5060 Ti 16GB. Blackwell FP4 native support. Top pick for 26B MoE. Source: compute-market.com
RTX 5060 Ti 16GB
NVIDIA · 16GB · 1 report
This page is thin (1 of 3 reports needed for indexing). Help fill it in.