llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× AMD Strix Halo 128GB · Gufo · 262,144 ctx

AMD hardware
Oct 11, 2026
Throughput
29.8 t/s gen · 1193.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
System RAM
128 GB

Summary

User reports Qwen3.8-Flash-Next at 29.80 t/s generation and 1193.06 t/s prefill on two AMD Strix Halo 128GB hosts. Setup is Gufo with two-host RDMA tensor parallelism over USB4 RoCE v2, full Q8_0 GGUF, 262144-token configured context, one session, speculative decoding off. Measured prompt was 2040 tokens with no cached prefix and 128 predicted tokens; the 262144 context is capacity, not a benchmark length. Source-reported third-party measurement, not independently reproduced.