llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M1 Max 32GB · MoEspresso

Tone: positiveApple hardware
Sep 27, 2026
Throughput
12-15 t/s gen
Quant
IQ2_K (MLX)
KV cache
KVarN K4/V4
System RAM
32 GB

Use cases

codingmath

Summary

User reports Qwen3.8-Flash-Next (125B) at 12-15 decode tokens per second on a 2021 M1 Max with 32 GB of unified memory. Setup is MoEspresso 3 with IQ2_K routed projections and KVarN K4/V4 KV cache, using Metal execution through the mlx-iqk library. Cache-Prior expert bias is enabled by default; prefill is unbiased. The user notes the speed holds only when no other memory-hungry applications are running. The user also reports an overall score of 84.3% on a reproducible 48-question benchmark, ahead of Claude Opus 4.8 xhigh (80.3%) and other hosted solutions.