llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× M3 Ultra 256GB · MTPLX

Tone: mixedApple hardware
Oct 17, 2026
Throughput
51-59 t/s gen
Quant
4-bit
System RAM
256 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 Flash-Next decoding at a median of 51-59 tokens/s (p90 ~65) on two M3 Ultra 256GB Mac Studios. Setup is MTPLX with a 4-bit mixture-of-experts model (107 GB on disk) and multi-token prediction, carrying 116-142k-token prompts with a 97-99% prompt-cache hit rate. The user also compares DeepSeek V4.1 Flash against MiMo V2.6 Flash head to head (8 agents each, 3 hours): 11 vs 7 PRs merged and 1 vs 4 stalls. DeepSeek costs about 1.6x per output token but less per merged PR, so every builder now runs DeepSeek.