Summary
User reports GLM-5.3-Flash at 580 tok/s prefill (3.5K) and 546 tok/s at 64K on a single Strix Halo 128GB mini PC (Ryzen AI Max+ 395, gfx1151).
Setup is the Kyojin engine built on ExLlamaV3 with EXL3 weights, 99.7 GB pack, MTP speculative decoding with 2 draft tokens.
Decode is 26 to 30 tok/s with MTP. A second model, MiMo-V2.6-Flash-MOPD (105 GB), reaches about 650 tok/s prefill at 4K and 32 prose / 35 chat / 44 code tok/s with speculation, 29 plain. KLD vs official FP8 is 0.151 for GLM and 0.0713 for MiMo. GLM at 128K context and other GPUs are not measured yet.