Qwen3.8 27B
on AMD Radeon AI PRO R9700 32GB · Lucebox
Summary
User reports Qwen 3.8 27B at 208.1 tok/s average on a Radeon AI PRO R9700, with a 227.8 tok/s peak request.
Setup is the Lucebox engine with UD-IQ4_XS GGUF weights and a DFlash2 Q8_0 drafter at block size 16, q8_0 KV cache, single card.
The figure is a HumanEval average; the repository also lists 110.6 tok/s for Qwen 3.8 27B on an RTX 5090 and 79.7 tok/s on 2x RTX 3090 with NVLink.