Qwen3.8 27B
on AMD RX 9060 XT 16GB · llama.cpp · 20,000 ctx
Summary
User reports Qwen 3.8 27B at 42.7 t/s generation and 658 t/s prefill at 20k context on a single RX 9060 XT 16GB.
Setup is a fork of llama.cpp (achyudh/llama.cpp) with an unsloth IQ4_XS GGUF, Q4 KV values with Q8 keys, MTP plus n-gram prediction, and KV cache streaming; 24GB of DDR5 system RAM, 16GB of it used for this model.
At 200k context the user reports 35 t/s generation and 300 t/s prefill, with a 262k context target. The user notes the build needed PCIe atomics fixes.