llamaperf
Sep 20, 2026
Throughput
70.0 t/s gen · 2000.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
W4A16 (AutoRound)

Use cases

coding

Summary

User reports Qwen3.8-Flash-Next at roughly 2,000 t/s prefill and 70 t/s decode on 4x Radeon Pro V620 32GB. Setup is Intel Autoround W4A16 weights running locally with the OMP harness, which the user believes made a big difference. The model ran for around 3 hours, mostly driving two browsers at once to test and fix a generated HTML/JS 3D game.