Qwen3.8 27B
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Qwen3.8-27B at 7.24 tok/s on a Strix Halo 128GB (Ryzen AI Max+ 395, Radeon 8060S).
Setup is llama.cpp build 9867 with Vulkan backend, UD-Q8_K_XL GGUF, -ngl 999 -fa on, single request, no MTP.
With MTP self-speculative decoding the same configuration reaches 16.46 tok/s on code. Q6 baseline without MTP runs 8.43-8.44 tok/s and Q6 with MTP 18.67-18.72 tok/s. At four concurrent slots, Q8 aggregate is 21.75 tok/s without MTP and 16.94 with.