Qwen3.8 27B
on 6× AMD RX 7900 XTX · vLLM · 262,144 ctx
Oct 1, 2026
Summary
User reports Qwen3.8 27B at BF16 generating about 50 t/s single user on six RX 7900 XTX GPUs.
Setup is vLLM with tensor parallel 6, achieved by padding the model architecture numbers with zeroes to make them divisible by six, at a 256k context window.
Aggregate throughput is 200 t/s with 8 concurrent prompts. GPU KV cache size is 520,784 tokens, giving a maximum concurrency of 1.99x for 262,144 tokens per request.