Qwen3.8 27B
on 2× AMD MI50 16GB · llama.cpp
Oct 3, 2026
Use cases
agenticcoding
Summary
User reports Qwen3.8-27B at 48 tok/s generation on two AMD Instinct MI50 16GB cards, up from 19.4 tok/s with stock llama.cpp.
Setup is patched llama.cpp (b11235) on ROCm 7.14 with Q4_0 weights, tensor split plus MTP speculative decoding with 3 draft tokens, 85 W per card.
The 48 tok/s is the patched result; the same setup without the gfx906 kernel patches gave 40-44 tok/s, and a vLLM gfx906 fork with GPTQ-Int4 and TP=2 reached 34.7 tok/s.