Qwen 3.5-35B-A3B / ROCm native PP512 TG128
on AMD Strix Halo 128GB · llama.cpp / ROCm HIP / benchmark build unknown
Summary
User reports Qwen3.5-35B-A3B at 44 t/s generation and 1079.9 t/s prompt processing on an AMD Strix Halo 128GB machine.
Setup is llama.cpp's llama-bench with the Q8_0 GGUF at -ngl 999, stock five repeats, depth 0, batch 2048 / ubatch 512, F16 K/V, flash attention off and mmap on.
The two phases are separate: PP 512 at 1079.88 +/- 55.12 t/s and TG 128 at 44.04 +/- 0.12 t/s, where the second is 128 synthetic single-token steps rather than a real 128-token answer, and no TTFT was measured.