llamaperf

DeepSeek V4.1 Flash 552B (16B active)

on AMD MI50 32GB · Strata · 7,500 ctx

Tone: positiveAMD hardware
Oct 29, 2026
Throughput
23.0 t/s gen · 170.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ1_M/IQ2_XS/IQ2_XXS (IST-DAS 2.00bpw) (GGUF)
System RAM
62 GB
VRAM reported
32 GB

Summary

User reports DeepSeek-V4.1-Flash at about 23 tok/s decode and ~170 tok/s prefill on a single AMD MI50 32GB. Setup is Strata with the IST-DAS 2.00bpw GGUF set (IQ1_M/IQ2_XS/IQ2_XXS experts), a separate 111 GB Engram table and the DSpark drafter, about 258 GB on disk, with 62 GB RAM and 24 CPU threads. Only ~23.6 GB of the 132 GB of experts fit on the card; the rest runs from a 46 GB RAM store and the SSD, so weights are offloaded. Decode was 15.8 tok/s by default, 16.7 with 24 CPU threads, 19.6 with --experts 5, and 22.6-23 with DSpark on at 0.65 confidence. Prefill was measured on a 7.5K-token prompt; short ~30-token prompts give ~30-40 tok/s. Contexts were tested only up to 8K with one request at a time, and the gfx906 support is a set of local patches, not upstream.