Qwen3.8 27B
on AMD Strix Halo 128GB · LM Studio
Summary
User reports Qwen3.8 27B at 26.47 t/s on a GMKtec NucBox EVO-X2 with AMD Ryzen AI Max+ 395 (Strix Halo) and 128 GB LPDDR5X-8000.
Setup is LM Studio's llama.cpp Vulkan build with Q4_K_M (lmstudio-community, 16.80 GB) and the model's built-in MTP speculative-decoding head on, thinking off.
Other quants measured with MTP: UD-Q4_K_XL (unsloth, 17.92 GB) 26.26 t/s, UD-Q8_K_XL (unsloth, 31.45 GB) 15.20 t/s, BF16 (unsloth, 54.66 GB) 10.50 t/s. Memory bandwidth measured at about 239 GB/s.