Qwen3.8 125B (6B active) Flash-Next
on M4 32GB · Cherenkov
Summary
User reports 8-22 t/s on a 32GB M4 MacBook Air with 21GB of allocations.
Setup is a custom inference engine called Cherenkov that combines predictive expert streaming with optional mixed-precision execution, keeping a bounded working set of experts in unified memory rather than loading the entire model.
A one-layer lookahead predicts which experts will be needed next and initiates SSD reads.