Mellum2.1 12B (2.5B active)
on M4 16GB · 130,000 ctx
Use cases
codingagentic
Summary
User reports JetBrains Mellum 2.1 12B A2.5B MoE running at around 60 t/s on an M4 16GB at full 130k context.
Setup uses a Q8 quant; the user notes a 16 GB GPU can run it easily.
The user also got 140 t/s on a 9070 XT and expects 8GB and 12GB cards to reach 30-40 t/s. They find it codes well but suggest a bigger model for detailed planning.