Qwen3.8 125B (6B active) Flash-Next
M3 Max 64GB · oMLX · 130,000 ctx
- generation:
- 15.8 tokens/s
- prompt processing (prefill):
- 140.0 tokens/s
- quant:
- oQ4e
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.
User reports Qwen3.8-Flash-Next at 15.8 tok/s generation and 140.0 tok/s prompt processing on an M3 Max 64GB. Setup is oMLX with an oQ4e quant, Lightning MTP on, MoE expert offload on and 50% resident experts, running a 99GB model at up to 130k context. Figures come from a 13-request session with PI: 321,309 total prefill tokens, 292,209 cached (90.9% cache efficiency), so the prompt rate excludes cached tokens.