Summary
User reports DeepSeek-V4.1-Flash 1017 at up to 38 tok/s decode and over 480 tok/s prompt processing on a single Strix Halo 128GB (Ryzen AI MAX+ 395, Radeon 8060S / gfx1151).
Setup is the libosmos engine with unsloth UD-IQ1_S weights plus an MXFP8 engram, with drafting enabled for the decode figure.
The figures are stated as ceilings ("up to"), and a huihui abliteration is said to be available through the engine.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
DeepSeek V4.1 Flash 552B · 16B active at 3-bit by hardware
- 73.4 t/s · one run
- 40.0 t/s · one run
Bars are medians on one scale, 0 to 73.4 tokens/s. Press ▶ to watch text arrive at a row's speed.
Models most run on the AMD Strix Halo 128GB
- 26.6 t/s · 8 runs
- 60.0 t/s · 7 runs
- 69.9 t/s · 6 runs
- 50.4 t/s · 4 runs
- 52.6 t/s · 4 runs
- 71.7 t/s · 4 runs
Bars are medians on one scale, 0 to 77.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the AMD Strix Halo 128GB →Every DeepSeek V4.1 Flash report →Estimate DeepSeek V4.1 Flash on this card →