vLLM on the AMD Radeon Pro V620 32GB
llamaperf has 4 vLLM reports on the AMD Radeon Pro V620 32GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.
4 vLLM reports on the AMD Radeon Pro V620 32GB
Newest first. A run on several cards, with speculative decoding, with part of the model in system RAM or with batched requests says so, since each describes a different setup.
- Qwen3.8 125B · 6B active · AWQ W4A1664.0 t/s(4 cards, part in system RAM)
- Qwen3.8 27B · Q442.0 t/s(2 cards)
- Qwen3.8 125B · 6B active · W4A1670.0 t/s(4 cards, speculative decoding)
- Qwen3.8 125B · 6B active · W4A1670.0 t/s(4 cards)
Frequently asked
How fast is vLLM on the AMD Radeon Pro V620 32GB?
llamaperf has 4 vLLM reports on the AMD Radeon Pro V620 32GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.