llamaperf

DeepSeek V4 Flash 150B REAP

on NVIDIA RTX 3060 12GB · FreeToken

Tone: mixedNVIDIA hardware
Sep 26, 2026
Throughput
2.8-3.4 t/s gen
Quant
FP4 (safetensors)
System RAM
64 GB
VRAM reported
12 GB

Use cases

codingtool-use

Summary

User reports DeepSeek V4 Flash REAP-150B at 2.8-3.4 tok/s on an RTX 3060 12GB with a Ryzen 9 7900 and 64GB DDR5-6000 under WSL2. Setup is FreeToken with FP4 experts and an experimental disk tier called Overspill; the expert math runs on the CPU via the AVX-512 path and experts stream from disk through RAM. The model is about 85GB. User compares against llama.cpp at 0.4-0.5 tok/s and Colibri at 1.1-1.2 tok/s, and reports TTFT of 102s for a 6.4k prompt, 43s for the first short prompt after cold start and 10s for the next short prompt. User notes the runs are not bit-identical because llama.cpp stores the non-expert weights in Q8_0 while FreeToken and Colibri use FP8, and asks others to test on different hardware.