Qwen3.8 125B (6B active) Flash-Next
on M1 16GB · Slotstream · 512 ctx
Summary
User reports Qwen3.8 Flash-Next at 1.76 t/s generation on a Mac mini M1 16GB, streaming experts from the internal SSD.
Setup is Slotstream 0.2.17 on MLX Swift with PipeNetwork's MLX 4-bit weights, one request, MTP off, a 512-token context and a 19-token prompt.
The model's 105 GB sits on disk while the process peaks near 5 GB of memory. A second run gave the same speed.