Qwen3.8 125B (6B active) Flash-Next
on M4 Pro 24GB · MoEShift · 8,192 ctx
Summary
User benchmarks Qwen3.8-Flash-Next (125B) on an M4 Pro Mac mini with 24GB unified memory, comparing their own engine MoEShift against Strata. With a 6,009-token prompt and 256 generated tokens, MoEShift reached 160.8 tok/s prefill and 9.9 tok/s decode in 63.3s total, against Strata's 61.8 tok/s prefill and 7.8 tok/s decode in 129.9s.
Both engines used the GSQ-RCO IQ3_XXS GGUF quant with an 8,192-token context window and no cached prompt tokens; times exclude process startup.
On a short 66-token prompt MoEShift decoded at 10.44 tok/s versus Strata's 8.4 tok/s, with peak process footprint 6.4GB versus 14GB. The user notes these are first measurements and more benchmarking is planned; the code is not yet public.