Qwen3.5 9B
on M3 Ultra 256GB · llama.cpp
Summary
User reports Qwen3.5 9B at 77.8 t/s generation and 1010.3 t/s prompt processing on an M3 Ultra 256GB.
Setup is llama.cpp with Q4_K_M, run through native llama-bench with -p 512 -n 128 -r 3.
The 77.83 ± 0.11 t/s and 1010.32 ± 1.28 tokens/s are native benchmark rates for 512/128 test tokens, not configured maximum context; KV precision, flash attention and GPU-offload count are unreported.