llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp

Tone: mixedAMD hardware
Oct 16, 2026
Throughput
17.6 t/s gen · 616.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q3_K_XL (GGUF)
System RAM
128 GB

Use cases

rplong-context

Summary

User benchmarks Qwen3.8-Flash-Next on a dual AMD Radeon AI PRO R9700 32GB setup (Lenovo P620, Threadripper Pro 3945WX, 128GB DDR4). Setup is llama.cpp with Unsloth UD-Q3_K_XL GGUF, -ncmoe 5, -ngl 49, tensor-split 1.10,0.90, and 3 MTP draft tokens. llama.cpp achieves 17.6 t/s generation and 616.5 t/s prompt processing, compared to 147.2 t/s and 6618.1 t/s on radiance 1.4.0, and 79.1 t/s and 1455.4 t/s on Strata 0.1.42. User notes radiance's prompt processing is unreasonably fast and adds a prefill slope metric. All three are considered equivalent in output quality for the user's purposes.