Qwen3.5 9B
M6 32GB · llama.cpp
- generation:
- 27.0 tokens/s
- quant:
- Q4_K_M (GGUF)
User reports Qwen3.5-9B at approximately 27 tokens/second decode on an Apple Mac mini M6 with 32GB unified memory. Setup is llama.cpp with Q4_K_M weights (5.5GB file) at empty prior context. The figure is from a Tweakers review sweep of prior context from empty to 90,000 tokens in 10,000-token increments; the sweep endpoint is not a verified maximum context capacity. Prefill, KV cache, offload and speculation settings are not reported for this result.