DeepSeek V4 284B Flash
2× AMD Radeon AI PRO R9700 32GB · 16,384 ctx
- generation:
- 51.1 tokens/s
- quant:
- q2
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is shown only when the source reports it; generation speed cannot tell us time to first token. Check the full setup before comparing.
User reports a Lucebox custom setup with an AMD Radeon AI PRO R9700 and Strix Halo 128GB running 3.63x faster than a single DGX Spark. Setup uses asymmetric parallelism: the R9700 handles the dense path, hot experts, cache and draft model, while the Strix Halo holds the other experts. The run is experimental, at q2 quant and 16k context. The user is working on KVFlash for 64k-128k.