Qwen3.8 125B (6B active) Flash-Next Uncensored
on M5 Ultra 256GB · 4,096 ctx
Use cases
coding
Summary
User reports Qwen3.8 Flash-Next Uncensored at 239.3 t/s generation and 4316.6 t/s prompt processing on an M5 Ultra 256GB, on a 4096-token prompt with 3000 output tokens.
Setup uses oQ5e weights with MTP speculative decoding, single request, peaking at 122.9 GB of memory.
Longer prompts slow decode to 155.0 t/s at 16384 tokens and 127.1 t/s at 65536 tokens. A 2x batch run gives 172.8 t/s aggregate generation and 1828.2 t/s prompt processing, a 0.72x speedup over baseline.