llamaperf

Muse 30B Glimmer

on 2× AMD Radeon Pro V620 32GB · llama.cpp · 65,536 ctx

Tone: positiveAMD hardware
Sep 8, 2026
Throughput
35.4 t/s gen · 355.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q6_K_XL (GGUF)
KV cache
f16

Summary

User benchmarks Muse Glimmer 30B on AMD v620 GPUs, with Q6 on one GPU at 355.38 t/s prefill and 35.38 t/s generation. Setup is a tensor split across two GPUs: Q6 gives 472.27 t/s prefill and 36.32 t/s generation, Q8 gives 550.04 t/s prefill and 26.55 t/s generation. Speculative decoding uses a dflash draft model.