DeepSeek V4.1 Flash 552B (16B active)

User benchmarks DeepSeek-V4.1-Flash-1017 on five NVIDIA A40s over PCIe, reporting 563.9 tok/s prefill at ~1.8K tokens with YOCO disabled. Setup is TensorSharp with UD-IQ2_XXS GGUF shards (~300.5 GB), tensor parallel 5, and the 125.9 GiB Engram table mapped in host memory under a 233.8 GiB host-memory limit. llama.cpp on the same files reached 174.6 tok/s at ~1.8K and 225.7 tok/s at ~7.3K, where TensorSharp gave 549.7 tok/s. Workload was real-text summarization, greedy decoding, 256 output tokens, three measured requests per prompt size.