Qwen3.8 27B
on 3× AMD Radeon AI PRO R9700 32GB · llama.cpp · 256,000 ctx
Oct 3, 2026
Summary
User reports Qwen3.8 27B at 29.92 t/s on a mixed GPU pool of R9700, RTX 5070 Ti, and RTX 4070 using llama.cpp RPC.
Setup is llama.cpp with Q8 quant and 256k context, using MTP speculative decoding. The RPC pool runs each card on its native driver (ROCm for R9700, CUDA for Nvidias).
User compares this to Vulkan solo on the R9700 (26.48 t/s) and their daily driver Q6_K_XL at 131k context (59.08 t/s). RPC showed tighter consistency (spread 7.4 vs 16.3). Flash Next saw no improvement.