DeepSeek
on NVIDIA L40S · Strata
Use cases
codingagentic
Summary
User reports prefill reaching 2,200 tokens/s on a local DeepSeek deployment (DeepSeek 1017 IQ2_XS) on an L40S 48GB with 1TB RAM.
Setup is a Sol-hacked custom engine built on Strata and Maya, with IQ2_XS weights.
User says cold prefill was fast but short incremental prefill passes between agent tool calls were slow in Codex; adding those to the optimization metrics cut end-to-end task time by around 15% with decode speed unchanged.