DeepSeek V4 Flash 284B (13B active)

User reports DeepSeek V4-Flash running at ~4.5-5 tok/s decode on an M5 Pro with 48 GB unified memory. Setup is a from-scratch MLX inference engine that keeps dense/attention weights resident at 8-bit and streams the 256 routed experts (mxfp4) from SSD into a device-side LRU cache, with CAP=1664 and MAX_CTX=32768. Decode is byte-bound by SSD expert streaming, and prefill and decode both cost about 200 ms per token. Lossless speculative decoding is built but does not fit in 48 GB, projecting ~6-7.5 tok/s at 64 GB.