Qwen3.8 27B

User reports Qwen3.8-27B at 53.1 tok/s single-stream on four Radeon AI PRO R9700 32GB cards in one box. Setup is vLLM-Radiance 1.0.387 (vLLM 0.30.0, ROCm 7.14) with the official FP8 checkpoint, FP8 KV cache, and the model's MTP head with 8 draft tokens, two engines per box at TP=2, 256K max context. At 16 users the box serves 484 tok/s aggregate (about 40 tok/s per user); a random 1024-in/512-out profile gives 623 tok/s aggregate at 837 W. MTP acceptance is 83% on JSON extraction versus 39% on MT-Bench. FP8 scored 98.0/100 versus MXFP4's 95.3/100 on the user's extraction workbench, at 4,477 versus 4,819 validated jobs an hour. Three such boxes were built at about $10,733.91 each.