llamaperf

Muse 30B Glimmer

on NVIDIA RTX 3090 · llama.cpp · 8,192 ctx

NVIDIA hardware
Oct 2, 2026
Throughput
30.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
64 GB
VRAM reported
24 GB

Use cases

math

Summary

User reports Muse Glimmer 30B at 29.96 t/s median completion throughput on an RTX 3090. Setup is llama.cpp (build 10437, CUDA) with GGUF Q4_K_M at 8,192 tokens of context, one concurrent request and no speculative decoding. The model used about 18.0 GB of VRAM on the 24 GB card, which ran at a fixed 280 W power limit. Median latency was 6.94 seconds per question; prompt processing speed was not reported separately.