Muse 30B Glimmer
on NVIDIA RTX Pro 4000 Blackwell SFF · llama.cpp · 262,116 ctx
Sep 8, 2026
Use cases
codinglong-context
Summary
User reports speculative decoding with DFlash reaching 84.64 t/s at 38.67% acceptance on a best tuned 256K run, against 17.98 t/s for regular decoding.
An NVFP4 hybrid reached 94.36 t/s but with worse perplexity, so Q5_K_M was chosen as best.
A context fill of 262,116 tokens completed without OOM using 22,920/24,467 MiB VRAM, with decode at 21.56 t/s.