Qwen2.5 1.5B

User reports Qwen2.5-1.5B-Instruct at 32.14 tok/s single-stream on an AMD Instinct MI50 32GB with vLLM. Setup is vLLM with unquantized FP16 weights on one MI50, one request, no speculative decoding, enforce-eager, ROCm flash attention, max model length 8192, in an unprivileged Proxmox LXC container. Under continuous batching aggregate throughput rises to 63.8 tok/s at 2 streams, 238.9 at 8 and 422.8 at 32. llama.cpp with 4-bit GGUF weights on the same card gave 31.25 tok/s single-stream and stayed near 31 at every concurrency. Qwen2.5-0.5B reached 648.2 tok/s aggregate.