Qwen3.8 125B (6B active) Flash-Next
on M5 64GB
Use cases
coding
Summary
User reports Qwen3.8 Flash-Next Q4 at 17.5 t/s decode and 360 t/s prompt processing on a Mac Mini M5 64GB, with experts streamed from SSD.
Setup streams experts from two external SSDs with a carousel buffer for prompt processing, which the user says added 30% to prompt processing and 15% to both prompt processing and decode.
The user notes the GPU still waits on expert streaming during decode and sees room for an optimised Metal kernel.