llamaperf

Bonsai 2 27B

on NVIDIA RTX 5060 Ti 16GB

Tone: mixedNVIDIA hardware
Oct 29, 2026
Throughput
57.4 t/s gen
Quant
PQ2
System RAM
64 GB
VRAM reported
16 GB

Use cases

agentictool-usecoding

Summary

User benchmarks Bonsai-2 27B PQ2 at 57.4 tok/s on an RTX 5060 Ti 16GB, where it finished 13 of 14 agent tasks and fixed 10, with no malformed tool calls. The run is part of a 39-model, 50-prompt comparison graded by four frontier models, with 3k-token outputs on a 5800X3D and 64GB RAM. Three of four judges named Bonsai-2 their favourite; judges flagged weak coding (1.5) and honesty (4.5), and it claimed no tests existed without running anything. Underdog-Saluki 27B scored the highest mean (6.42) at 40.9 tok/s, Gemma-4 12B Q6 reached 92.0 tok/s, and LFM3 1.7B was fastest at 192 tok/s but last overall. Rankings are trustworthy to about 0.4 points.