Qwen3.5 9B
on M6 32GB · llama.cpp
Summary
User reports Qwen3.5-9B at approximately 27 tokens/second decode on an Apple Mac mini M6 with 32GB unified memory.
Setup is llama.cpp with Q4_K_M weights (5.5GB file) at empty prior context.
The figure is from a Tweakers review sweep of prior context from empty to 90,000 tokens in 10,000-token increments; the sweep endpoint is not a verified maximum context capacity. Prefill, KV cache, offload and speculation settings are not reported for this result.