DeepSeek V4 Flash 150B REAP
on NVIDIA RTX 3060 12GB · FreeToken
Use cases
codingtool-use
Summary
User reports DeepSeek V4 Flash REAP-150B at 2.8-3.4 tok/s on an RTX 3060 12GB with a Ryzen 9 7900 and 64GB DDR5-6000 under WSL2.
Setup is FreeToken with FP4 experts and an experimental disk tier called Overspill; the expert math runs on the CPU via the AVX-512 path and experts stream from disk through RAM. The model is about 85GB.
User compares against llama.cpp at 0.4-0.5 tok/s and Colibri at 1.1-1.2 tok/s, and reports TTFT of 102s for a 6.4k prompt, 43s for the first short prompt after cold start and 10s for the next short prompt. User notes the runs are not bit-identical because llama.cpp stores the non-expert weights in Q8_0 while FreeToken and Colibri use FP8, and asks others to test on different hardware.