DeepSeek V4 Flash 284B (13B active)
on M5 Pro 64GB · ds4 · 32,768 ctx
Summary
User reports 10-17 t/s in SSD streaming mode.
Setup keeps routed experts partly in RAM cache and pulls them from the GGUF on cache misses. Experts and output head are Q8_0, while router, embeddings and V4 auxiliary blocks are FP16.