Qwen3.8 27B
on AMD RX 9070 · 131,072 ctx
Summary
User reports Qwen3.8 27B at about 60 t/s on a 16 GB RX 9070 XT at 128k context.
Setup uses the ISTA-DASLab GSQ-RCO IQ3_XXS GGUF with a HermiHg DFlash2 Q2_K_S draft model for speculative decoding, and a K 8_0 / V 4_0 KV cache.
User says this beats the built-in MTP, which multiplies VRAM use, and calls it one of the best single-thread choices on a 16 GB GPU. Speculative decoding is more sensitive to GTT overflow, so disabling it is faster when exceeding VRAM on a DDR5 PCIe 5 system.