llamaperf

Qwen3.5 35B (3B active)

on 2× M1 Ultra 128GB · llama.cpp · 200,000 ctx

Tone: positiveApple hardware
Oct 19, 2026
Throughput
115-120 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
Q8
System RAM
128 GB

Use cases

agentictool-use

Summary

User reports Qwen3.5-35B-A3B at roughly 115-120 tok/s on a Mac Studio M1 Ultra 128GB plus an RTX 3090 24GB over a Thunderbolt 5 eGPU. Setup is llama.cpp with Q4_K_M, about 17GB of the model on the 3090 and about 5GB on the Mac, with the KV cache quantized to Q8. The user says the Q8 KV cache lets them run about 200K context entirely in VRAM, and that this model replaced a two-model agentic setup.