Muse 30B Glimmer
on AMD RX 7600 XT 16GB · llama.cpp · 62,144 ctx
Use cases
coding
Summary
User reports Muse Glimmer 30B at about 308 t/s prompt processing and about 20 t/s generation on an RX 7600 XT 16GB.
Setup is llama.cpp with ROCm, the UD-Q2-K-XL quant and DFlash speculative decoding.
The run completed a coding task.