Qwen3.8 27B

User reports Qwen3.8-27B running on the M6 Neural Engine via ANEMLL Forge 0.2.1, with about 27 tok/s decode and 123 tok/s prefill at 96K context on a 32GB M6 Mac Mini. Setup uses an INT8 K/V cache and a smaller drafter sharing the target's output head, with about 21.4 GB total memory at 96K context. Decode varies by content: JSON 35–62 tok/s, code 18–32, prose 10–17. Prefill is 260 tok/s at short context and 62 at 192K, where a smaller prefill batch of 32 rows is used. The user calls 96K the sweet spot for size and speed on 32GB.