Qwen3.8 27B
on AMD Ryzen AI 9 HX 470 96GB · llama.cpp
Summary
User reports Qwen 3.8 27B at 12-15 t/s generation on an AMD Ryzen AI 9 HX 470 with 96 GB RAM using the strix-halo-llamacpp fork.
Setup is the Nathanw1014 strix-halo-llamacpp fork of llama.cpp, which the user picked after testing several forks.
On stock llama.cpp, Qwen 3.8 27B and Qwen 3.8 Flash both ran at 10-12 t/s with about 50 t/s prompt processing. With the fork, Flash reaches 15-18 t/s.