GLM-5.3 320B (18B active) Flash
on NVIDIA RTX 3090 · Project Maya
Use cases
codingagentic
Summary
User reports about 15 t/s running GLM-5.3 Flash at Q2 on an RTX 3090 with DDR4 RAM and SSD offload, under an engine called Project Maya.
The setup streams part of the model from system memory and disk, since a Q2 GLM-5.3 Flash does not fit in the card's 24GB alone.
User's main complaint is behavioral rather than speed: directed to start a new project, the model continued on an old project with a similar name and made little to no improvement, a mistake no other model or engine made in the same environment.