Qwen 3.5-9B / ROCm native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp / ROCm HIP / benchmark build unknown
Summary
User reports Qwen3.5-9B at 23.1 t/s generation and 1130.6 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp's llama-bench with Q8_0 and -ngl 999, run through docker compose on ROCm 7.2.1.
The two figures come from separate synthetic phases: PP 512 at 1130.63 +/- 21.38 t/s and TG 128 at 23.11 +/- 0.03 t/s, where the second phase is 128 single-token steps rather than a real 128-token answer. No TTFT was measured.