Qwen 3.5-27B / ROCm native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp / ROCm HIP / benchmark build unknown
Summary
User reports Qwen3.5-27B at 7.5 t/s generation and 296.9 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp's llama-bench with Q8_0 and F16 K/V cache, run with -ngl 999 on a Radeon 8060S.
The two phases are separate: PP 512 at 296.89 +/- 24.46 t/s and TG 128 at 7.49 +/- 0.01 t/s, where the second is 128 synthetic single-token steps rather than a real 128-token answer.