Minimax M2.1 IQ4_XS / ROCm b7819 / native PP4096 and separate TG512
on AMD Radeon 8060S integrated GPU (Strix Halo; installed RAM unreported) · llama.cpp b7819 / 557515be1 / ROCm 6.4.4
Summary
User reports Minimax M2.1 at 28.3 t/s generation and 248.5 t/s prompt processing on a single Radeon 8060S Graphics (gfx1151) via ROCm.
Setup is llama-bench with IQ4_XS at 4.25 bpw, -ngl 999, -fa 1, -p 4096 and -n 512, one repetition.
Native figures were PP4096 248.52 and TG512 28.28 t/s, both with zero deviation; the model is 113.52 GiB and 228.69 B parameters.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.