1.0 t/s gen · 50.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
4bit
System RAM
32 GB
Summary
User reports DeepSeek V4 Flash 0731 at about 50 t/s prefill and about 1 t/s decode on an M5 Air with 32 GB.
Setup uses the streamed experts trick with a model of roughly 300B total parameters.