GLM-5.3 320B (18B active) Flash
on NVIDIA RTX 3090 · ExLlamaV3 · 131,072 ctx
Oct 9, 2026
Summary
User reports GLM-5.3-Flash at 28.55 tok/s decode on an RTX 3090.
Setup is ExLlamaV3 with exl3-3.05bpw and 131k context, all-RAM fast mode with CPU offload requiring ~238 GB free RAM.
Lab suite passed 6/6 with 28.6 tok/s decode and 989 tok/s prefill; at concurrency 4 the aggregate was 28.62 tok/s (28.45 per stream) because fast mode decodes one stream at a time.