Qwen3.5 122B (10B active)
on AMD Strix Halo 128GB · llama.cpp
Summary
User benchmarks Qwen3.5 122B A10B at 19.17 t/s generation on a Strix Halo 128GB.
Setup is llama.cpp with UD-Q6_K_XL GGUF, ROCm 7.2.3, full GPU offload, no MTP speculation. The model is 106.04 GiB.
With MTP enabled the same model reaches 26.86 t/s. Prompt processing peaks at 266.48 t/s with batch size 512. A dense Gemma 4 31B Q4_K_M comparison runs at 10.48 t/s.