llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M5 64GB

Tone: positive
Oct 5, 2026
Throughput
17.5 t/s gen · 360.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4 (GGUF)
System RAM
64 GB

Use cases

coding

Summary

User reports Qwen3.8 Flash-Next Q4 at 17.5 t/s decode and 360 t/s prompt processing on a Mac Mini M5 64GB, with experts streamed from SSD. Setup streams experts from two external SSDs with a carousel buffer for prompt processing, which the user says added 30% to prompt processing and 15% to both prompt processing and decode. The user notes the GPU still waits on expert streaming during decode and sees room for an optimised Metal kernel.