GLM-4.7 30B (3B active) Flash
on AMD Radeon 680M · llama.cpp
Use cases
codingrpcreative-writingtool-usesummarizationvisionagenticmathmultilinguallong-context
Summary
User benchmarks GLM-4.7 Flash (30B-A3B MoE) on an AMD Radeon 680M iGPU with 64GB DDR5 RAM, comparing MXFP4, Q4_K_M, and Q4_K_XL quants. The Q4_K_XL quant achieves the fastest generation at 13.13 t/s, while MXFP4 leads prompt processing at 258.36 t/s. Setup uses llama.cpp with Vulkan backend and Flash Attention enabled; models are offloaded to system RAM due to iGPU memory limits.