Qwen3.8 27B

User reports 29.8 t/s generation and 1287 t/s prompt processing. Source evidence (verbatim): Source: https://akougkas.io/journal/2026/serving-qwen38-27b-on-a-radeon-ai-pro-r9700/ # Serving Qwen3.8-27B on a Radeon AI PRO R9700 is not a one-liner Hardware: Radeon AI PRO R9700 (Navi 48, gfx1201) with 32 GB VRAM and 640 GB/s, Ryzen 7 5700X3D (8 cores), Ubuntu 24.04.4, kernel 6.17 OEM. Engine: llama.cpp b10687 (commit c841aee), HIP build on ROCm 7.2.4. Model: Qwen3.8-27B, Unsloth IQ4_NL (15.21 GiB). Single-stream llama-bench with no speculative decoding: -ngl 99 -fa 1 -ctk q8_0 -ctv q8_0 -p 2048 -n 512 gave 1287 tokens/s prefill (pp2048) and 29.8 tokens/s decode (tg512). The same bench for other quants: UD-Q4_K_XL 1151 / 26.7, UD-Q5_K_M 946 / 24.5, UD-Q6_K 821 / 23.2 (prefill / decode tokens/s).