llamaperf

Qwen3.6 35B (3B active)

on M5 Max 128GB · llama.cpp · 128,000 ctx

Apple hardware
Sep 7, 2026
Throughput
79.4 t/s gen · 2153.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8 XL
System RAM
128 GB

Summary

User benchmarks several models on an M5 Max 128GB and selects Qwen3.6 35B A3B as the primary model for its MoE detail. Other models tested include Gemma 4, Qwen 3.6 27B, MiniMax M2.7, Mistral Medium 3.5, Step 3.7 Flash and DeepSeek V4 Flash. Results show strong performance for MoE models.