Muse Glimmer-30B text decoder, Core AI int4hu
on M4 Max 128GB · Apple Core AI (coreai-pipelined GPU)
Summary
User reports Muse at 26.7 t/s generation and 269 t/s prompt processing on an M4 Max 128GB.
Setup is Apple's coreai-pipelined GPU engine with int4hu block32 symmetric quantization, text decoder only, 16.35 GB bundle size.
The source table pairs 269.0 tok/s prompt with 26.69 tok/s decode under llm-benchmark at 512 prompt / 1024 generation, 3 trials; aggregation, cache state and batch configuration for that row are not stated.