GLM-5.3 320B (18B active) Flash
on AMD RX 7900 XT · Project Maya · 8,192 ctx
Summary
User reports GLM-5.3-Flash at ~415 tok/s prefill and ~15 tok/s decode on an RX 7900 XT 20 GB.
Setup is Project Maya (v1.0.11, experimental AMD ROCm port) with Maya-S quant, 8K context, ROCm 7.2, 4K-token prompts, greedy sampling; the dGPU box has 192 GB of RAM, with hot experts in VRAM, next in pinned RAM and the rest on NVMe.
Other configurations: Radeon AI PRO R9700 32 GB at ~500 tok/s prefill and ~20 tok/s decode; Strix Halo (Ryzen AI Max+ 395, 8060S, 128 GB) at ~210 tok/s prefill and ~18 tok/s decode; R9700 + 7900 XT with layer split and MTP drafting at ~490 tok/s prefill and ~34 tok/s decode. With less RAM more experts come from the SSD and decode drops.