llamaperf

Qwen 3.8-Flash-Next / Gufo 0.12.0 / native PP4096 and TG128

on AMD Strix Halo 128GB · Gufo 0.12.0 / ROCm HIP

AMD hardware
Oct 13, 2026
Throughput
26.0 t/s gen · 1489.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 26 t/s generation and 1489 t/s prompt processing on an AMD Strix Halo 128GB box. Setup is Gufo 0.12.0 with ROCm/HIP, UD-Q4_K_XL GGUF, on the single Radeon iGPU; the bench path accepts only concurrency 1. The figures are separate native microbenchmarks, PP4096 at 1489 t/s and TG128 at 26 t/s, not one 4096-in/128-out request; the 32768-token prompt phase is recorded separately at 1400 t/s.