Qwen3.8 27B
on 2× AMD Radeon Pro V620 32GB · vLLM · 41,000 ctx
Oct 8, 2026
Use cases
agentic
Summary
User reports Qwen 3.8 27B at up to 42 t/s on 2x Radeon Pro V620 32GB cards at 41k context.
Setup is vLLM 0.27.1 with a Q4 quant and tensor parallelism of 2.
The first working run gave 11-18 t/s; after optimization the two-card combo reached 42 t/s. A four-card TP=4 config for a 122B MoE reaches 56-59 t/s. A successor repo runs Qwen3.8-Flash-Next at ~100 t/s single-stream on 4x V620, versus 29-30 t/s for llama.cpp on the same box.