DeepSeek V4 Flash 284B (13B active)
on 2× NVIDIA RTX PRO 6000 Max-Q · llama.cpp · 8,192 ctx
Summary
User reports DeepSeek-V4-Flash on 2x RTX PRO 6000 Blackwell Max-Q 96GB (192GB total), with prompt processing 36.5-39.4 t/s and token generation 34.1-41.7 t/s.
Setup is llama.cpp wip/deepseek-v4-support branch with a native FP4 + FP8 GGUF (146GB, 4.39 bits per weight), ctx-size 8192, batch 4096, Flash Attention disabled, no speculative decoding, single request, short prompts of 14-50 tokens.
GPU utilization was 30-40% burst; power draw was 97.8W on GPU0 and 115W on GPU1.