Qwen3.8 125B (6B active) Flash-Next
M6 32GB · Strata · 65,536 ctx
- generation:
- 10.0 tokens/s
- prompt processing (prefill):
- 200.0 tokens/s
- quant:
- Q2_0 (GGUF)
User reports Qwen3.8-Flash-Next at about 10 tok/s generation and about 200 tok/s prefill on a Mac Mini M6 with 32 GB. Setup is Strata with a Q2_0 quant at 64K context. User says quality seems on par with 4-bit Qwen3.8-27B and that the fans almost never turn on with Strata, unlike the 27B run with Splash.