DeepSeek V4 284B Flash
on 2× AMD Radeon AI PRO R9700 32GB · 16,384 ctx
Summary
User reports a Lucebox custom setup with an AMD Radeon AI PRO R9700 and Strix Halo 128GB running 3.63x faster than a single DGX Spark.
Setup uses asymmetric parallelism: the R9700 handles the dense path, hot experts, cache and draft model, while the Strix Halo holds the other experts.
The run is experimental, at q2 quant and 16k context. The user is working on KVFlash for 64k-128k.