Qwen3.8 27B
on 2× AMD Radeon AI PRO R9700 32GB · vLLM
Sep 26, 2026
Summary
User reports Qwen3.8 27B at 113 t/s on 2x Radeon AI PRO R9700 32GB.
Setup is vLLM with MXFP4 and tensor parallelism 2, after moving the second card to CPU lanes with an M.2-to-PCIe riser so PCIe atomics and P2P work.
User compares Windows LM Studio (31 t/s on 2 cards, 38 t/s on 1), Vulkan with MTP (39-55 t/s), Linux llama.cpp Q8 tensor split (34.4 t/s, up to ~52 on other prompts), vLLM MXFP4 TP=1 (45 t/s) and vLLM FP8 TP=2 (72 t/s). User settled on Qwen3.8 27B Q8 at around 72+ t/s for daily use.