llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M4 Pro 24GB · MoEShift · 8,192 ctx

Tone: positiveApple hardware
Oct 29, 2026
Throughput
9.9 t/s gen · 160.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_XXS (GGUF)
System RAM
24 GB

Summary

User benchmarks Qwen3.8-Flash-Next (125B) on an M4 Pro Mac mini with 24GB unified memory, comparing their own engine MoEShift against Strata. With a 6,009-token prompt and 256 generated tokens, MoEShift reached 160.8 tok/s prefill and 9.9 tok/s decode in 63.3s total, against Strata's 61.8 tok/s prefill and 7.8 tok/s decode in 129.9s. Both engines used the GSQ-RCO IQ3_XXS GGUF quant with an 8,192-token context window and no cached prompt tokens; times exclude process startup. On a short 66-token prompt MoEShift decoded at 10.44 tok/s versus Strata's 8.4 tok/s, with peak process footprint 6.4GB versus 14GB. The user notes these are first measurements and more benchmarking is planned; the code is not yet public.