llamaperf

Qwen3.8 27B

on AMD RX 6900 XT 16GB · LM Studio

Tone: mixedAMD hardware
Oct 14, 2026
Throughput
19.0 t/s gen
Quant
IQ4_XS (GGUF)
System RAM
32 GB
VRAM reported
16 GB

Use cases

codingagenticlong-context

Summary

User reports Qwen3.8 27B at 19 tok/s with speculative decoding on an RX 6900 XT 16GB. Setup is LM Studio with IQ4_XS weights on the Vulkan backend, single GPU, 32GB system RAM. Without speculation the same model and quant runs at 11 tok/s; a Qwen 27B Q3_K_M run gives 8.4 tok/s and a Qwen 4B gives 51 tok/s with thinking off and 38 tok/s with it on. User asks whether Linux/ROCm would beat Vulkan on Windows and whether these speeds are normal for the card.