llamaperf

Qwen3.8 125B (6B active) Flash-Next

on M4 Max 64GB · llama.cpp

Tone: mixedApple hardware
Sep 7, 2026
Throughput
36.0 t/s gen · 517.9 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
AD-3.84bpw-M64 (GGUF)
System RAM
64 GB

Summary

User reports a 85 GB GGUF quant of Qwen 3.8 Flash Next running on a 64 GB MacBook with the ngram table offloaded to SSD, at 517.9 t/s prefill and 36 t/s decode. The user notes the quant quality is far from perfect and better versions are planned.