DeepSeek V4 Flash REAP
on Unknown GPU · llama.cpp
Summary
User reports DeepSeek-V4-Flash-0731-REAP at ~20.5 t/s generation with an extreme 2-bit quantization.
Setup is IQ2_XXS with mixed quantization (w2Q2K-AProjQ8-OutQ8), reduced from 95GB bf16 to 54GB.
Output stays coherent despite the aggressive quantization.