SenseNova-U1.5 8B MoT
on M5 Ultra · llama.cpp
Use cases
vision
Summary
User reports SenseNova-U1.5-8B-MoT at 125 t/s generation and 3482 t/s prompt processing on an M5 Ultra.
Setup is llama.cpp (llama-bench, Metal, all layers on GPU) with the Q4_K_M GGUF at 5.32 GiB; BF16 gave 56 t/s and Q8_0 88 t/s on the same table.
Through llama-mtmd-cli the Q4_K_M model caught a deliberately wrong $1.00 subtotal on a fake receipt in 16 s including load, and read back a menu, a whiteboard and three bilingual signs without error in 4 to 10 s each, though those images were made by the same model.