Qwen 3.5-27B / ROCm native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp / ROCm HIP / benchmark build unknown
Summary
User reports Qwen3.5-27B at 11.3 t/s generation and 295.2 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp via docker compose with the Q4_K_M GGUF at -ngl 999, stock F16 K/V cache and flash attention off.
The two phases are separate synthetic runs: PP 512 at 295.17 +/- 24.78 t/s and TG 128 at 11.27 +/- 0.01 t/s, where the second is 128 single-token steps rather than a 128-token answer. No TTFT was measured.