llamaperf

Qwen3.8 27B

on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp

Tone: positiveAMD hardware
Sep 21, 2026
Throughput
37.0 t/s gen · 1069.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)

Summary

User reports Qwen3.8 27B at 37 t/s generation and 1069 t/s prompt processing on two Radeon AI PRO R9700 32GB cards in a GMKtec EVO-X2 Strix Halo machine. Setup is llama.cpp with the ROCm build, RCCL enabled via -DGGML_HIP_RCCL=ON, and the UD-Q4_K_XL GGUF. The GPUs connect over NVMe-to-USB4 enclosures and run at PCIe 4.0 x4. Tensor parallelism was slower than a single card under the Vulkan build; the ROCm build restored a decode speedup, and RCCL restored full prompt processing. Single card measured 28 t/s generation and 1070 t/s prompt processing.