Qwen3-VL 4B
on M4 Pro 64GB · dasLLAMA
Summary
User reports Qwen3-VL-4B-Instruct at 54.2 t/s generation and 957.9 t/s prompt processing on an M4 Pro with 64 GB unified memory.
Setup is dasLLAMA with Q8_0 weights, q8 activations, f16 scales and f16 KV cache, one GPU, 640 positions allocated.
The figures are native synthetic counts: 512 prompt positions and 128 serial decode positions, not a single chat request.