GLM-5.3 320B (18B active) Flash
on NVIDIA RTX 2080 Ti · llama.cpp
Use cases
coding
Summary
User reports GLM-5.3-Flash 320B at about 7 tok/s on an RTX 2080 Ti 11GB.
Setup is llama.cpp with Q4 weights (200GB) and MoE experts kept in system RAM via -ncmoe, on a box with 256GB of DDR4-3600 and an i9-10940X.
User calls it slow for hard questions but workable, and plans to benchmark more models on real reverse-engineering tasks.