Qwen3.5 4B
on M4 Pro 48GB · llama.cpp · 32,768 ctx
Use cases
codingagentic
Summary
User reports Qwen3.5-4B think at ~150 t/s on an M4 Pro 48GB.
Setup is llama.cpp with Q4_K_M at 32k context, using 2.5 GB of RAM.
The model scores 6/7 on the CC-Agent harness and 14/14 on the V3.1 text suite, matching the 35B-A3B model at 1/8 the memory.