Qwen3.5 4B

User reports the Qwen3.5 4B notes model in their LokalBot app generating at about 85 tok/s on an M4 Max with 48 GB. Setup is llama.cpp (bundled llama-server, Metal) with Q4_K_M at 32K context; the app loads five local models totalling 9.6 GB on disk and evicts them under a budget of half the machine's RAM. Notes for a 26-minute meeting took 33 s with the model warm and 60 s including the load. Autocomplete measured 56 ms median and 102 ms p95 per keystroke, query embedding 9 ms, and the Nemotron 3 speaker model 14.6% DER on 8 AMI recordings at about 500x real time. All numbers come from that one machine; no 16 GB, M1, M2 or M3 figures were measured.