DeepSeek V4
on 3× NVIDIA RTX 3090 · llama.cpp · 1,000,000 ctx
Summary
User reports 1M lossless context on 3x RTX 3090 with DDR5, at 15 t/s on cold start and 10 t/s steady.
Setup is a llama.cpp fork with deepseek4 architecture support. A fourth RTX 3090 runs gemma 12b and flux2klein.
Prefill starts at 300 t/s and degrades to 100 t/s after 64,000 tokens.