Qwen3.8 27B
on AMD Radeon AI PRO R9700 32GB · vLLM
Sep 7, 2026
Summary
User reports Qwen3.8-27B-FP8 at roughly 50-56 t/s generation on two Radeon AI PRO R9700 GPUs in TP=2 on PCIe Gen5 x8, with an AMD Ryzen 5 7400 CPU and 64 GB of DDR5-6000.
Setup uses MTP3 speculative decoding, with accepted throughput of roughly 30-37 t/s.
User asks whether these numbers are reasonable and where to look for bottlenecks.