llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Radeon AI PRO R9700 32GB · llama.cpp · 131,072 ctx

Tone: mixedAMD hardware
Oct 5, 2026
Throughput
36.0 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
q8_0
System RAM
64 GB
VRAM reported
32 GB

Use cases

agentictool-usecoding

Summary

User reports Qwen3.8-Flash-Next at ~36 tok/s single stream on a single Radeon AI PRO R9700 32GB with 64GB system RAM. Setup is llama.cpp with stew675's RDNA4 patches (r30), AtomicChat Q4_K_M quant, q8_0 KV cache, flash attention, 2 slots x 131k context, -ncmoe 41 and MOE_EXPERT_CACHE_MIB=4096, GPU capped at 220W. Two streams combined reach ~50 tok/s and prompt reading is 526-589 tok/s. The 27B Q5_K_XL is ~1.7x faster per turn and reads prompts 1.6-2x as fast, but scores lower on tool-eval-bench Hard Mode (79.8 vs 93.9).