Muse 30B Glimmer
on Unknown GPU · llama.cpp
Use cases
coding
Summary
User reports speculative decoding with DFlash at a peak of 287 t/s and an average of 173 t/s.
Prompt processing runs 1000-2100 t/s on short prompts and 2654 t/s on long ones. Draft acceptance is 63.3-97.5%, with a mean accepted draft length of up to 14 tokens, and KV cache reuse is 99.9%.
The user compares it to Qwen 3.6 27B and reports no Chinese language-mixing bugs, no overthinking loops, and concise responses.