Qwen3.8 27B
on AMD Radeon AI PRO R9700 32GB · vLLM
Sep 17, 2026
Summary
User reports Qwen3.8 27B NVFP4 at 120 tok/s at concurrency 1 on a single AMD Radeon R9700, with prefill at 3,619 tok/s at 16000 depth.
Setup is a vLLM fork (radiance-vllm-mxfp4) with Unsloth's Qwen3.8 27b NVFP4 weights on one card.
Median decode varies by category from 67.1 tok/s on chat to 153.1 tok/s on json, while update p50 stays between 34.2 and 42.5 ms. Concurrency scales to 471 tok/s at 8 concurrent requests.