llamaperf
Oct 10, 2026
Throughput
41.5 t/s gen · 621.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ2_XXS gate/up + Q2_K down; BF16 n-grams on SSD (GGUF)
MTP (Multi-Token Prediction)
off
System RAM
64 GB

Summary

User reports Qwen3.8 Flash-Next at 41.5 t/s generation and 621.3 t/s prefill on an M4 Max 64GB. Setup is ds4 with IQ2_XXS gate/up + Q2_K down; BF16 n-grams on SSD, one request, speculative decoding off. First row (2,048-token prompt) of pswai's 64gb-mac-llm-bench, measured 2026-09-28. A source-reported measurement, not independently reproduced.