StepFun 3.7 Step 3.7 Flash / IQ4_XS / ROCm b9843 native PP2080 d512
AMD Radeon 8060S integrated GPU (Strix Halo; system RAM unreported) · llama.cpp b9843 (86b94708f) / stock ROCm
- prompt processing (prefill):
- 288.8 tokens/s
- quant:
- IQ4_XS (GGUF)
- kv:
- F16
- flash attention:
- on
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.
User reports StepFun 3.7 at 288.8 t/s prompt processing on an AMD Ryzen AI MAX+ 395 with Radeon 8060S graphics. Setup is llama.cpp b9843 with IQ4_XS, f16 K/V cache and flash attention, one participating Radeon via ROCm with ngl=999. The 288.8 t/s figure is the stock batch2048/ubatch512 arm at depth 512, measured over three repeats; the same arm falls to 146.025623 t/s at depth 100000.