llamaperf

Qwen3.8 27B

on AMD RX 7900 XTX · llama.cpp

AMD hardware
Oct 23, 2026
Throughput
37.1 t/s gen · 877.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
VRAM reported
24 GB

Summary

User reports Qwen3.8 27B at 37.09 t/s generation and 877.84 t/s prompt processing on an AMD Radeon RX 7900 XTX under llama.cpp's Vulkan backend. Setup is llama.cpp (build 10438) with a UD-Q4_K_XL GGUF of 16.68 GiB, run with GGML_VK_DISABLE_HOST_VISIBLE_VIDMEM=1 because Resizable BAR is disabled in the BIOS; without that variable token generation is slow. At a 4096-token context depth the same run gives 36.33 t/s generation and 812.34 t/s prompt processing.