llamaperf

GLM-4.7 30B (3B active) Flash

on AMD Radeon 680M · llama.cpp

Tone: mixed
Oct 5, 2026
Throughput
13.1 t/s gen · 160.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
System RAM
64 GB

Use cases

codingrpcreative-writingtool-usesummarizationvisionagenticmathmultilinguallong-context

Summary

User benchmarks GLM-4.7 Flash (30B-A3B MoE) on an AMD Radeon 680M iGPU with 64GB DDR5 RAM, comparing MXFP4, Q4_K_M, and Q4_K_XL quants. The Q4_K_XL quant achieves the fastest generation at 13.13 t/s, while MXFP4 leads prompt processing at 258.36 t/s. Setup uses llama.cpp with Vulkan backend and Flash Attention enabled; models are offloaded to system RAM due to iGPU memory limits.