DeepSeek
Summary
User reports DeepSeek at 1.75 bpw decoding at a median 11.7 t/s on an RTX 5060 Ti 16GB in a 64 GB RAM PC, with experts streamed from an SSD cache.
The figure comes from 36 decode requests comparing nominal expert-cache budgets; the --ssd-cache 63 setting reached 11.7 t/s median in both rounds.
The article distinguishes configured cache budgets from resident RAM usage and examines speed, memory headroom and reclamation.