llamaperf

Maple Preview 20B (1B active)

on M4 16GB · Mference · 131,072 ctx

Tone: positiveApple hardware
Sep 7, 2026
Throughput
20.0 t/s gen · 40.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
ternary
System RAM
16 GB

Summary

User reports Maple Preview, a 20B A1B MoE trained from scratch in ternary precision, generating at around 20 tokens/s on a MacBook Air M4. Setup is the user's Maple integration in Mference, a fork of turbo-fieldfare that keeps the weights on SSD and streams MoE experts from disk, using between 500 and 1,200 MB of memory depending on context length. Prompt processing runs at around 40 tokens/s, although the title gives 40 tps generation. On Tau-2 the user measured 0.48 Airline, 0.175 Retail and 0.427 Telecom.