DeepSeek V4 Flash 284B (13B active)
on GTX 1060 6GB
Summary
User reports DeepSeek-V4-Flash at 3.2 t/s generation with a Bartowski MXFP4 quant, running CPU only on an E5-2699v4 Xeon with 512Gb of 4-channel DDR4 2133.
The GTX 1060 6Gb in the machine is too weak, so the user runs CPU only.
GLM 5.2 in Q4_K_XL runs at 1.8 t/s on the same rig. The user expected more than 5 t/s and suspects the MXFP4 format.