llamaperf

DeepSeek V4 Flash 284B (13B active)

on M3 Ultra 512GB · ds4

Tone: positiveApple hardware
Sep 7, 2026
Throughput
475.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
512 GB

Summary

User reports DeepSeek V4 Flash serving on an M3 Ultra 512GB with the ds4 engine, with cold prefill improved from 392 to 475 t/s at 64k context through kernel optimizations. Cache prewarming with max_tokens:0 yields roughly 10x speedup for chat turns, from 6-20s down to 1.6s.