Inkling-Small 276B (12B active)

User reports Inkling-Small 276B-A12B at 2.86 tok/s decode on an M5 with 24GB, with a peak footprint of about 9.5 GB. Setup is Mference with the pipenetwork/Inkling-Small-MLX-4bit conversion: 3.4 GB resident and about 148 GB on disk. Decode holds at 2.93 tok/s on a 421-token prompt and 2.56 tok/s on a 2,785-token one, but that longer prefill took 535.9 s. The user also tested an M3 Ultra 256GB at 5.31-6.92 tok/s.