Qwen3.8 27B
on Unknown GPU · beellama.cpp · 32,768 ctx
Summary
User benchmarks Qwen3.8-27B on 16 GB of VRAM across several quants, including IQ4_XS and AD-IQ3_S-IQ3_XXS, and KV cache formats including kvarn4.
The recommended config is Qwen3.8-27B-IQ4_XS-pure-MTP.gguf with beellama.cpp, a kvarn4 KV cache, MTP speculative decoding, and 32k-48k context.
Quality metrics are 92.55% Top-1 match and 0.1169 KLD against Q8_0. The user also references Qwen3.6-27B quantizations from an external source.