GLM-5.3 Flash
on 4× Mixed AMD GPUs (two Strix Halo APUs and two Radeon AI PRO R9700 cards) · llama-halo-hybrid (llama.cpp fork) · 131,072 ctx
Summary
User reports GLM-5.3 at 30 t/s on a two-node cluster of two Strix Halo APUs and two Radeon AI Pro R9700 cards, one 32 GB card per node.
Setup is the sixvolts/llama-halo-hybrid HIP/ROCm llama.cpp fork with RPC, UD-Q4_K_XL GGUF at 131072 context, batch 32768, ubatch 1024, -fa on, and draft-MTP with up to two drafts on the head-node R9700.
The 30 t/s is a reported decode rate at a prompt labeled 25.8K, alongside 92 ms/step and MTP acceptance 0.90; the timing primitive and aggregation formula are unknown.