- generation:
- 11.0 tokens/s
- prompt processing (prefill):
- 280.0 tokens/s
- quant:
- IQ4_XS (GGUF)
User reports GLM-5.3-Flash at about 11 tok/s on an RX 9070 XT 16GB, with long prompts read at about 280 tok/s on Linux. Setup is the user's own engine with IQ4_XS GGUF, experts streamed from NVMe drives with hot experts kept on the GPU and in RAM, on a Core Ultra 7 265KF with 32 GB DDR5 and two NVMe drives. Windows gives about 10 tok/s and about 250 tok/s prompt reading. Testers measured about 11 tok/s on an Intel Arc Pro B70 32GB and 5.6 tok/s on an RTX 3090 plus RTX 3060; the 12-13 and 6.5-7 tok/s figures are expectations from logs, not measurements. The model needs about 157 GB on disk and 32 GB of RAM.