llamaperf

Qwen3.8 125B (6B active) Flash-Next Uncensored

on M5 Ultra 256GB · 4,096 ctx

Tone: positiveApple hardware
Nov 10, 2026
Throughput
239.3 t/s gen · 4316.6 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
oQ5e
System RAM
256 GB

Use cases

coding

Summary

User reports Qwen3.8 Flash-Next Uncensored at 239.3 t/s generation and 4316.6 t/s prompt processing on an M5 Ultra 256GB, on a 4096-token prompt with 3000 output tokens. Setup uses oQ5e weights with MTP speculative decoding, single request, peaking at 122.9 GB of memory. Longer prompts slow decode to 155.0 t/s at 16384 tokens and 127.1 t/s at 65536 tokens. A 2x batch run gives 172.8 t/s aggregate generation and 1828.2 t/s prompt processing, a 0.72x speedup over baseline.