llamaperf

Qwen3.8 27B Swift-1.5

on 2× AMD Radeon AI PRO R9700 32GB · vllm-radiance

Tone: positiveAMD hardware
Oct 6, 2026
Throughput
130.0 t/s gen · 5000.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
FP8 (FP8)

Use cases

coding

Summary

User reports Qwen3.8 27B (Swift 1.5) at 130 t/s generation and 5000 t/s prefill on dual Radeon AI PRO R9700 32GB cards. Setup is vllm-radiance with FP8 weights. User asks whether any other RDNA4-specific engine could beat this, and is interested in running Qwen3.8 Flash-Next, which vllm-radiance does not yet support.