Muse 30B Glimmer
on NVIDIA RTX 5090 Laptop 24GB · llama.cpp · 128,000 ctx
Use cases
agentic
Summary
User reports Muse Glimmer 30B at 110.3 tok/s greedy decode and 3,254 tok/s prefill on an RTX 5090 Laptop 24GB card.
Setup is a patched llama.cpp with an MLP-NVFP4 hybrid quant, DFlash 2 speculative decoding at depth 15, and 128K context.
A baseline llama.cpp build with unsloth UD-Q4_K_XL and Meta DFlash reached 80.6 tok/s decode and 1,430 tok/s prefill on the same 6,880-token prompt. A 100,554-token prompt prefilled at 2,367 tok/s, and an agent turn with a cached 46K prompt took 0.89 s. KLD vs Q8_0 rose to 0.053/0.030/0.034 (agent/English/Swedish) from 0.033/0.012/0.015.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Muse 30B at 4-bit by hardware
- NVIDIA RTX 309024 GB30.0 t/s · one run
- 18.0 t/s · one run
Bars are medians on one scale, 0 to 30.0 tokens/s. Press ▶ to watch text arrive at a row's speed.
Models most run on the NVIDIA RTX 5090 Laptop 24GB
- Qwen3.8 27B4-bit33.5 t/s · 2 runs
- Qwen3 14B4-bit3.6 t/s · one run
- 107.0 t/s · one run
Bars are medians on one scale, 0 to 107.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the NVIDIA RTX 5090 Laptop 24GB →Every Muse report →Estimate Muse on this card →