Qwen3.8 27B
on 2× AMD Radeon AI PRO R9700 32GB · vLLM · 16,384 ctx
Sep 25, 2026
Summary
User reports Qwen3.8 27B at 184.9 t/s generation and 3,948 t/s prompt processing on 2x Radeon AI PRO R9700 32GB.
Setup is vLLM with MXFP4 weights at 16,384 tokens of context; a 256K configuration is mentioned separately.
The same model on the same machine reached 19.2 t/s generation and 590 t/s prompt processing with default llama.cpp Q8_0, and 29.7 t/s generation and 1,458 t/s prompt processing with llama.cpp Q8_0 using gfx1201 and tensor split.