Qwen3.8 27B
on AMD RX 9070 · Unsloth Studio · 128,000 ctx
Use cases
coding
Summary
User reports Qwen3.8-27B at 35-50 tok/s on an RX 9070 16GB, used for coding help.
Setup is Unsloth Studio with UD-IQ3_XXS GGUF and q4_0 KV cache, micro-batch 256, context set to 128000, taking 15.50 GiB of VRAM.
The user says the model is stuck at very high thinking and asks about offloading to 32GB DDR5 or SSD, noting 27B spilled outside the GPU is horribly slow and 30B-A3B Q3/IQ3 variants run fast but seem stupid.