DeepSeek V4 Flash 284B (13B active)
on NVIDIA RTX 5090 · llama.cpp · 262,144 ctx
Sep 7, 2026
Summary
User reports 700 pp/s and 18 tg/s with llama.cpp using --cpu-moe on a Threadripper 5965WX with an RTX 5090.
User notes llama.cpp does not support native FP8 cache for DFV4 Flash, so an FP16 cache is required, and speculative decoding is not working.
User suggests building a rig with an Epyc and 2x 5060 Ti.