DeepSeek V4 Flash 284B (13B active)
on 2× Blackwell 5000 48GB · llama.cpp
Summary
User reports DeepSeek V4 Flash at 16 t/s on a Blackwell 5000 with CPU offloading.
Setup is the UD-Q3_K_XL quant at roughly 120 GB, on a Blackwell 5000 with 48 GB and an RTX 3090 with 24 GB, plus 96 GB of RAM.
Using both GPUs drops throughput to 11-12 t/s or fails to fit. User asks for help with multi-GPU configuration.