Qwen3.5 9B
on M4 Max 64GB · vllm-mlx
Summary
User reports Qwen3.5-9B at 82.53 tokens/second generation on a Mac Studio M4 Max with 64GB unified memory.
Setup is vllm-mlx with a 4-bit MLX quant, measured by llama-benchy over 2048 prompt tokens and 32 generated tokens across three runs. A generation peak of 87.99 tokens/second and a TTFT of 2.41 seconds are also reported.
Exact quantization scheme, model artifact, runtime versions, configured context limit, concurrency, speculative decoding status and resident memory usage are not stated. The 64GB is system memory capacity, not measured memory use.