Qwen3.6 35B (3B active)
on AMD Strix Halo 128GB · llama.cpp
Summary
User reports Qwen3.6-35B-A3B at 45.6 t/s generation and 1339.4 t/s prefill on an AMD Strix Halo 128GB system.
Setup is llama.cpp with Q8_K_XL and Flash Attention, using a patched ROCm 7.2.3 container with -ngl 99, -fa 1, -mmp 0, -dio 1, -b 2048, -ub 2048.
The headline combines separate pp512 and tg128 phase tests, not one paired request; the baseline control reports 1083.55 t/s prefill and 45.82 t/s generation.