Muse 30B Glimmer
on NVIDIA RTX 5090 · vLLM · 25,000 ctx
Sep 7, 2026
Use cases
agentic
Summary
User reports 421 tok/s at 25k context on an RTX 5090 with muse-glimmer 30B, using a v2.2 optimizer profile for vLLM.
Setup runs without DFlash speculative decoding, with TTFT at 224ms (p95 500ms) and TPOT at 23ms.
Cost drops from $3.41 to $0.65 per 1M output tokens and energy from 4.72 to 1.08 J/tok. The user mentions SWE-Bench agents.