llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · llama.cpp

Tone: positiveAMD hardware
Sep 13, 2026
Throughput
52.0 t/s gen · 1300.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Summary

User reports Qwen3.8 Flash-Next at 52 t/s decode and 1300 t/s prefill on Strix Halo. Setup is forked llama.cpp builds and halogen-flash-server, described as roughly double decode and 5-6x prefill performance over prior Strix Halo results. User offers a community reflection on local LLM optimization rather than a detailed benchmark report.