Qwen3.8 125B (6B active) Flash-Next
M2 Pro 16GB · Strata · 128,000 ctx
- generation:
- 5.5 tokens/s
- prompt processing (prefill):
- 77.0 tokens/s
- quant:
- iQ3_xxs (GGUF)
User reports Qwen3.8 Flash-Next at a median 77 tok/s prefill and 5.5 tok/s decode on a 16GB M2 Pro Mac Mini. Setup is Strata with the iQ3_xxs quant at up to 128k context; experts are swapped across prompts, so the user assumes speeds reflect worst-case full-context behavior. The medians span tests from 16k to 120k context. The user calls it a barely passable chat generator and a last-resort code helper, and notes heavy SSD write load.