Muse 30B Glimmer
on NVIDIA RTX 3090 · llama.cpp · 8,192 ctx
Oct 2, 2026
Use cases
math
Summary
User reports Muse Glimmer 30B at 29.96 t/s median completion throughput on an RTX 3090.
Setup is llama.cpp (build 10437, CUDA) with GGUF Q4_K_M at 8,192 tokens of context, one concurrent request and no speculative decoding. The model used about 18.0 GB of VRAM on the 24 GB card, which ran at a fixed 280 W power limit.
Median latency was 6.94 seconds per question; prompt processing speed was not reported separately.