Qwen3 8B CLM-v0.1
on M3 Pro · MLX
Summary
User reports CLM-v0.1-8B, a frozen Qwen3-8B encoder with fp32 heads, at ~336 tok/s on an M3 Pro.
Setup is MLX with an 8-bit checkpoint of 7.5 GiB, peaking at 9 GB of memory.
Checked against the authors' vLLM server on 778 questions with 99.0% top-1 agreement, within their own run-to-run noise. Unofficial community port, not reviewed by the CLM authors.