Bonsai 2 27B Ternary

User reports Ternary-Bonsai-2-27B at PTQ1_0 running on a 32 GB RTX PRO 4500 Blackwell via llama.cpp, with 36.5 tok/s decode and 909 tok/s prefill at 32,768 tokens of context in a single stream. Setup uses the 6.58 GB ternary GGUF with a 131,072-token context window; the Q8_0 mmproj vision tower still works in the ternary GGUF. At 131,072 tokens of context the single stream drops to 14.1 tok/s decode, 630 tok/s prefill and 207 s time to first token. Two and four concurrent streams at 32,768 tokens give 12.4 and 4.6 tok/s decode per stream, and the concurrent cells at 131,072 tokens returned HTTP 500. The user notes decode collapses with concurrency, unlike EXL3 rows which hold a flat decode rate.