llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M4 24GB · Strata · 8,192 ctx

Tone: mixedApple hardware
Oct 19, 2026
Throughput
8.1 t/s gen
Quant
Q2_0 (GGUF)
System RAM
24 GB

Summary

User reports Qwen3.8-Flash-Next 125B at 8.1 t/s on an M4 Mac mini with 24GB unified memory. Setup is Strata with GSQ-RCO Q2_0 weights, Metal backend, 8K context configured and a 4GB expert weight cache, streaming expert weights from the SSD. The figure is the median of three 128-token generation runs with thinking disabled, temperature 0 and no MTP, on short prompts; the full 8K context was not tested. User calls the speed slow for everyday interactive work but usable for patient experiments, and notes frequent memory-pressure warnings with no swap use during the short tests.