Muse 30B Glimmer
on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 131,768 ctx
Sep 7, 2026
Summary
User reports a model fits on a single RTX 5060 Ti 16GB at 131k context with a Q4 KV cache.
Setup uses GGUF weights only, with no dflash or mmproj loaded.
A Q8 KV cache allows about 90k context.