Qwen3.8 27B
on 4× AMD Radeon AI PRO R9700 32GB · vLLM-Radiance · 262,000 ctx
Summary
User reports Hermes with Qwen 3.8 27B fp8 at 262k context on a quad R9700 setup, with prefill at 17636 t/s and TG at 36.6 t/s.
Setup is vLLM-Radiance, with one GPU on PCIe 4x8 and three on 4x16.
Best TG reached 106 t/s with 80% MTP 4 acceptance. vLLM-Radiance works well with the quad setup despite official dual support.