llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M6 32GB · Strata · 65,536 ctx

Tone: positiveApple hardware
Oct 23, 2026
Throughput
10.0 t/s gen · 200.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q2_0 (GGUF)
System RAM
32 GB

Summary

User reports Qwen3.8-Flash-Next at about 10 tok/s generation and about 200 tok/s prefill on a Mac Mini M6 with 32 GB. Setup is Strata with a Q2_0 quant at 64K context. User says quality seems on par with 4-bit Qwen3.8-27B and that the fans almost never turn on with Strata, unlike the 27B run with Splash.