llamaperf
Sep 7, 2026
Throughput
30.0 t/s gen
Quant
Q4_K_XL

Summary

User asks what minimum VRAM GPU is needed to run DeepSeek-V4-Flash-0731 Q4_K_XL at around 30 t/s. The model is an MoE with 13B active parameters, and the user is considering GPUs up to 48 GB of VRAM. No specific hardware or engine is mentioned.