llamaperf

Qwen3.5 9B

on M4 Max 64GB · ZINC

Apple hardware
Oct 13, 2026
Throughput
67.1 t/s gen · 546.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
MTP (Multi-Token Prediction)
off
System RAM
64 GB

Summary

User reports Qwen3.5 9B at 67.1 t/s generation and 546.3 t/s prompt processing on an M4 Max 64GB. Setup is ZINC with Metal, Q4_K_M, speculative decoding disabled, and an auto-sized context; the run used 48 prompt tokens and 96 output tokens. The stored 67.1 t/s is the median of three samples, with the source's own median listed as 67.05 t/s over a 67 to 67.34 t/s range.