Qwen3.8 27B
on NVIDIA RTX 3090 · llama.cpp · 32,768 ctx
Summary
User compares two llama.cpp setups on the same GPU: Q5 with a Q8 KV cache, 32K context, 4 slots and MTP off at about 35 t/s, against Q4 with a Q4 KV cache, 131K context, 1 slot and MTP on at about 65 t/s.
User notes the trade-offs between the two configurations.