llamaperf

DeepSeek V4 Flash 284B (13B active)

on M1 Max 64GB · llama.cpp · 65,536 ctx

Tone: positiveApple hardware
Sep 7, 2026
Throughput
8.0 t/s gen · 30.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3-XXS
System RAM
64 GB

Summary

User reports DeepSeek-V4-Flash-0731 at about 8 t/s decode and about 30 t/s prefill on an M1 Max 64GB. Setup is a patched llama.cpp with the IQ3-XXS quant at 104 GB and context limited to 64k.