DeepSeek V4.1 Flash 552B (16B active)
on AMD MI50 32GB · Strata · 7,500 ctx
Summary
User reports DeepSeek-V4.1-Flash at about 23 tok/s decode and ~170 tok/s prefill on a single AMD MI50 32GB.
Setup is Strata with the IST-DAS 2.00bpw GGUF set (IQ1_M/IQ2_XS/IQ2_XXS experts), a separate 111 GB Engram table and the DSpark drafter, about 258 GB on disk, with 62 GB RAM and 24 CPU threads. Only ~23.6 GB of the 132 GB of experts fit on the card; the rest runs from a 46 GB RAM store and the SSD, so weights are offloaded.
Decode was 15.8 tok/s by default, 16.7 with 24 CPU threads, 19.6 with --experts 5, and 22.6-23 with DSpark on at 0.65 confidence. Prefill was measured on a 7.5K-token prompt; short ~30-token prompts give ~30-40 tok/s. Contexts were tested only up to 8K with one request at a time, and the gfx906 support is a set of local patches, not upstream.