Qwen3.8 27B
on Unknown GPU · llama.cpp
Use cases
agentic
Summary
User benchmarks Qwen3.8 27B IQ3_XXS against Bonsai Ternary PQ2 on a 16GB VRAM GPU.
Setup is llama.cpp with MTP speculative decoding for Qwen; Bonsai lacks MTP. Qwen completed the agent suite in 8:00 versus 24:09 for Bonsai, using 27,197 output tokens versus 84,176.
Weighted decode was 83.59 tok/s for Qwen and 64.91 tok/s for Bonsai. User notes the test is not scientific and prefers the IQ3_XXS visual results.