llamaperf

Qwen3.8 27B

on AMD RX 9070 · Unsloth Studio · 128,000 ctx

Tone: positiveAMD hardware
Oct 18, 2026
Throughput
35-50 t/s gen
Quant
UD-IQ3_XXS (GGUF)
KV cache
q4_0
System RAM
32 GB
VRAM reported
16 GB

Use cases

coding

Summary

User reports Qwen3.8-27B at 35-50 tok/s on an RX 9070 16GB, used for coding help. Setup is Unsloth Studio with UD-IQ3_XXS GGUF and q4_0 KV cache, micro-batch 256, context set to 128000, taking 15.50 GiB of VRAM. The user says the model is stuck at very high thinking and asks about offloading to 32GB DDR5 or SSD, noting 27B spilled outside the GPU is horribly slow and 30B-A3B Q3/IQ3 variants run fast but seem stupid.