llamaperf

Muse 30B Glimmer

on NVIDIA RTX 3090 · llama.cpp · 262,144 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
94.0 t/s gen · 1400.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
KV cache
F16
VRAM reported
24 GB

Use cases

visionlong-contextagentic

Summary

User reports Muse Glimmer fits on a single RTX 3090 at Q4_K_XL with full context, DFlash and mmproj, using about 22-23 GB of VRAM. Generation speed ranges from 64 to 124 t/s depending on prose versus code, with an average of 94 t/s. Prompt processing runs at about 1400 t/s. The user notes Qwen3.6-27B and Gemma-4-31B are borderline unusable on the same GPU.