llamaperf

Qwen3.8

on 2× AMD Radeon AI PRO R9700 32GB · llama.cpp · 131,072 ctx

Tone: mixedAMD hardware
Oct 28, 2026
Throughput
30.0 t/s gen
Quant
Q6_K (GGUF)
System RAM
144 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 at Q6_K reaching 30 t/s on a mixed AMD Radeon AI PRO R9700 32GB plus NVIDIA RTX 4500 Ada setup, versus 40 t/s on the R9700 alone. Setup is llama.cpp (self-compiled Vulkan) with layer split, 131072 context, moe-cache-mib 12000, batch-size 16384 and ubatch-size 2304, with n-cpu-moe 999. Gemma 4 QAT gave 32 t/s mixed versus 50 t/s on the R9700 alone, and Qwen Flash Next Q4_K_M gave 9 t/s versus 14 t/s. Tensor split gave inconsistent results; the user suspects the slower Ada 4500 or PCIe latency and asks what else the setup could be used for.