Qwen3.8 27B
on 4× AMD RX 7900 XTX · llama.cpp · 51,000 ctx
Oct 8, 2026
Use cases
coding
Summary
User reports Qwen3.8-27B Q8 at 77 t/s decode at 51K depth and 1,816 t/s prefill over a 51K prompt on four RX 7900 XTX cards after a series of ROCm and llama-server fixes.
Setup is 4x RX 7900 XTX on PCIe 4.0 x16 in a Lenovo P620, Q8 weights, a locally patched llama.cpp with MTP speculative decoding.
Before the fixes the same run gave 57 t/s decode at 51K and 1,454 t/s prefill; code decode went from 54-61 to 96-110 t/s. The patches are not yet published.