llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp · 131,072 ctx

Tone: positiveAMD hardware
Sep 7, 2026
Throughput
35.0 t/s gen · 242.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
Q8
System RAM
64 GB
VRAM reported
32 GB

Summary

User reports that 2 GPUs outperform 3 due to a slow lane. Setup is Qwen3.8 Flash Next with the Q4_K_M quant, variant AD-4.27bpw.