llamaperf

AMD RX 6900 XT 16GB reports

5 reports. These are individual setups, not a controlled benchmark. AMD RX 6900 XT 16GB speeds and models →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

AMD hardware
generation:
40-45 tokens/s
quant:
Q2

User reports Qwen3.8 Flash-Next at around 40-45 tok/s on an RX 6900 XT 16GB, depending on the prompt. Setup is Strata with a Q2 quant on a 32GB DDR4 system (Ryzen 7 5700X, B450 board). User asks whether to upgrade to 64GB RAM with an X570 board or add a second 6800/6900 XT for 16GB more VRAM, noting the current board's second slot is PCIe 2.0 x4. A dual-GPU goal would be Qwen3.8 27B at Q4 or higher.

Oct 21, 2026
Tone: positiveAMD hardware
generation:
41.5 tokens/s
quant:
Q2_0 (GGUF)
kv:
Q8
coding

User reports Qwen3.8 Flash-Next at 41.5 t/s on an RX 6900 XT 16GB, generating a roughly 4500-token animated SVG response; a Python task ran at about 32 tok/s. Setup is Strata with Q2_0 weights, 64k context and Q8 KV cache, using around 13.2GB VRAM on a Ryzen 7 5700X with 32GB DDR4 3600. The user has not filled the 64k context yet and wonders whether Q4 KV would allow more; the plan is 64GB RAM with IQ3_S, and IQ3_XXS is also being considered.

Oct 17, 2026
Tone: mixedAMD hardware
generation:
19.0 tokens/s
quant:
IQ4_XS (GGUF)
codingagenticlong-context

User reports Qwen3.8 27B at 19 tok/s with speculative decoding on an RX 6900 XT 16GB. Setup is LM Studio with IQ4_XS weights on the Vulkan backend, single GPU, 32GB system RAM. Without speculation the same model and quant runs at 11 tok/s; a Qwen 27B Q3_K_M run gives 8.4 tok/s and a Qwen 4B gives 51 tok/s with thinking off and 38 tok/s with it on. User asks whether Linux/ROCm would beat Vulkan on Windows and whether these speeds are normal for the card.

Oct 14, 2026
Tone: mixedAMD hardware
generation:
25.0 tokens/s
quant:
GSQ-RCO

User reports Qwen3.8-Flash-Next at 25 tok/s on an RX 6900 XT installed in a retired HP DL380p server with 172 GB DDR3 and 2x 10-core CPUs. Setup is Strata with llama.cpp and an HTTP router, GSQ-RCO quant at 64k context. The GPU is powered by an external desktop PSU; total draw is 250 W idle and about 450 W while inferring. User also reports Qwen3.8-27B with GSQ-RCO-IQ3_XXS and MTP at 192k context reaching 45 tok/s. The machine is a prototype; user plans a flexible riser and a proper GPU platform, and may add Nvidia P40s in the remaining slots someday.

Oct 6, 2026
Tone: positiveAMD hardware
generation:
30-45 tokens/s
quant:
IQ3_XXS (GGUF)
kv:
q8_0/q4_0
mtp (multi-token prediction):
on

User reports running Qwen3.8-27b (Huihui abliterated, IQ3_XXS) on an RX 6900 XT 16GB with llama.cpp and ROCm 10. Prefill drops from 400 t/s to 260 t/s at 40k context; decode varies between 30 t/s and 45 t/s. Setup uses 100k context, KV cache q8_0/q4_0, flash attention, ngram-mod, MTP with n=2, and mmproj in system RAM; VRAM fills to 15.7/16 GB.

Sep 26, 2026