Qwen3.8 27B
on AMD RX 7900 XTX · llama.cpp · 184,320 ctx
Use cases
codingagentic
Summary
User reports Qwen3.8-27B at 69.63 t/s generation on an RX 7900 XTX 24GB, with prompt processing at 383.02 t/s.
Setup is llama.cpp 2.61.0 (Vulkan/RADV) via LM Studio with Q4_K_M and q8_0 KV cache, 184320-token context, flash attention on, all layers on GPU and about 23.3 of 24 GiB VRAM in use.
Speculative decoding was on (MTP draft plus ngram, up to 2 draft tokens), so decode is inflated versus a plain run; draft acceptance was 0.558-0.68. A second 512-token run reached 64.09 t/s decode and 239.97 t/s prompt. One request at a time, nothing offloaded to system RAM.