llamaperf
Oct 30, 2026
Throughput
24.5 t/s gen · 1228.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ1_M (GGUF)

Use cases

codingvisionlong-context

Summary

User reports DeepSeek V4.1 Flash at 24.5 t/s decode and 1,228 t/s prefill on a single Strix Halo with their Gufo fork. Setup is Gufo with the IQ1_M GGUF resident, HTTP with real chat prompts, greedy decoding and thinking off; DSpark speculation reaches 30.7 t/s on mixed text and 73.6 t/s on repetitive text at depth 0. At 32K depth decode is 24.1 t/s with 1,177 t/s prefill, and at 128K 23.1 t/s with 1,045 t/s prefill. Eight concurrent users get 86.1 t/s total plain and 73.8 t/s with DSpark on mixed text. IQ2_XXS now runs with experts streamed from a Samsung 990 PRO SSD, at 20.8 t/s decode and 1,064 t/s prefill at depth 0.