llamaperf
Oct 9, 2026
Throughput
47.6 t/s gen · 994.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
128 GB

Summary

User reports Qwen3.8 Flash-Next decode at 47.6 t/s on Strix Halo 128GB, with prefill of 994 t/s at 2K context. Setup is a custom Windows attempt with speculative decoding; prefill reaches 1,026 t/s at 8K and 1,015 t/s at 32K, and decode without speculation is 34.0 t/s short, 30.7 t/s at 32K and 28.6 t/s at 128K. User compares against Linux and Windows results from Halogen, gufo, strix-alloy and strixllama, and reports 30/30 on a 68K truncation test. No repo shared yet.