llamaperf

Qwen3.6 35B (3B active)

on M1 Pro 32GB · llama.cpp · 32,768 ctx

Tone: mixedApple hardware
Oct 4, 2026
Throughput
25.4 t/s gen · 38.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_S (GGUF)
KV cache
q8_0/q4_0
System RAM
32 GB

Use cases

codingagentictool-uselong-context

Summary

User reports Qwen3.6-35B-A3B at 25.4 tok/s decode and 38.6 tok/s prefill on a MacBook Pro M1 Pro 32GB. Setup is llama.cpp build b9466 with Q4_K_S GGUF and q8_0/q4_0 KV cache at 32K context, single sequence, all layers on the Metal GPU. User compares the MoE against dense Qwen3.6-27B on the same host: the dense model decodes at 5.3 tok/s and prefills at 12.9 tok/s, uses 17.9 GB wired versus 22.4 GB, and swaps ~1 GB versus ~7.6 GB. Prefill is the bottleneck; cold TTFT on a 7.5K prompt is 92.8 s versus 0.2 s warm. Tool-calling was clean in 10/10 episodes.