Qwen3.8 125B (6B active) Flash-Next
on M5 Pro 64GB · Slipstream · 130,000 ctx
Use cases
codingmathagentic
Summary
User reports Qwen3.8-Flash-Next at 40.8 tok/s on an M5 Pro 64GB Mac using the Slipstream engine.
Setup is Slipstream with Q4_0 GGUF weights and SSD expert streaming, running the 95.5 GiB model on a single 64GB machine.
The figure is the average across six reasoning and coding tasks, compared to 23.1 tok/s in a llama.cpp fork (1.76x speedup). Decode stays between 33 and 44 tok/s out to 130,000 tokens across 3,086 live requests. An optional Swift KV-sparse variant scores 70.3% overall on 145 paired evaluation problems versus 67.6% for the original.