DeepSeek V4.1 Flash 552B (16B active)

User reports DeepSeek V4.1 Flash at 40.3–40.7 t/s single-stream decode on 8× NVIDIA A40 GPUs with Q2_K GGUF weights. Setup is TensorSharp with layer splitting, F16 KV cache, and 65K context; prefill is 533–539 t/s. Engram tables are ~60 GiB and kept on GPU. With Q4_K_M, single-stream decode is 31.0–32.5 t/s and prefill 452–492 t/s; aggregate decode is 39.3 t/s at 2 concurrent, 48.9 t/s at 4, and 48.5 t/s at 8. Layer split beats routed-MoE tensor parallelism on this machine, ~32 t/s vs ~22 t/s, because the cards have no NVLink.