llamaperf

Qwen3.6 35B (3B active)

on M5 Max 128GB · llama.cpp · 65,536 ctx

Tone: positiveApple hardware
Oct 4, 2026
Throughput
105.0 t/s gen
Quant
Q8_0 (GGUF)
System RAM
128 GB

Use cases

coding

Summary

User reports Qwen3.6-35B-A3B at 105 tok/s decode at 128 context and 97 tok/s at 8k on an M5 Max 128 GB. Setup is llama.cpp with Q8_0 GGUF weights, MTP speculative decoding on, 65536 context, 45 GB memory. Without MTP the same model gives 93 tok/s at 128 and 87 tok/s at 8k; MLX gives 85 and 79 tok/s. MTP adds 75% on the dense 27B (17 to 32 tok/s) but only 12% on the MoE 35B-A3B. llama.cpp beats MLX by 10-24% on this machine. DeepSeek-V4-Flash under ds4 at q2-q4 (91 GB) reaches 33 tok/s at 128 and 28 tok/s at 8k.