llamaperf

GLM-5.3 320B (18B active) Flash

on NVIDIA RTX 3090 · Project Maya

Tone: negativeNVIDIA hardware
Oct 18, 2026
Throughput
15.0 t/s gen
Quant
Q2
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports about 15 t/s running GLM-5.3 Flash at Q2 on an RTX 3090 with DDR4 RAM and SSD offload, under an engine called Project Maya. The setup streams part of the model from system memory and disk, since a Q2 GLM-5.3 Flash does not fit in the card's 24GB alone. User's main complaint is behavioral rather than speed: directed to start a new project, the model continued on an old project with a similar name and made little to no improvement, a mistake no other model or engine made in the same environment.