llamaperf

AMD RX 6900 XT 16GB

AMD · 16GB · 5 reports

Is this your card?

Engines people use on it: Strata 2 (reports) · LM Studio 1 (reports)

Run models on your AMD RX 6900 XT 16GB? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance on the AMD RX 6900 XT 16GB

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 16 GB of VRAM. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

AMD hardware
generation:
40-45 tokens/s
quant:
Q2

User reports Qwen3.8 Flash-Next at around 40-45 tok/s on an RX 6900 XT 16GB, depending on the prompt. Setup is Strata with a Q2 quant on a 32GB DDR4 system (Ryzen 7 5700X, B450 board). User asks whether to upgrade to 64GB RAM with an X570 board or add a second 6800/6900 XT for 16GB more VRAM, noting the current board's second slot is PCIe 2.0 x4. A dual-GPU goal would be Qwen3.8 27B at Q4 or higher.

Oct 21, 2026
Tone: positiveAMD hardware
generation:
41.5 tokens/s
quant:
Q2_0 (GGUF)
kv:
Q8
coding

User reports Qwen3.8 Flash-Next at 41.5 t/s on an RX 6900 XT 16GB, generating a roughly 4500-token animated SVG response; a Python task ran at about 32 tok/s. Setup is Strata with Q2_0 weights, 64k context and Q8 KV cache, using around 13.2GB VRAM on a Ryzen 7 5700X with 32GB DDR4 3600. The user has not filled the 64k context yet and wonders whether Q4 KV would allow more; the plan is 64GB RAM with IQ3_S, and IQ3_XXS is also being considered.

Oct 17, 2026
Tone: mixedAMD hardware
generation:
19.0 tokens/s
quant:
IQ4_XS (GGUF)
codingagenticlong-context

User reports Qwen3.8 27B at 19 tok/s with speculative decoding on an RX 6900 XT 16GB. Setup is LM Studio with IQ4_XS weights on the Vulkan backend, single GPU, 32GB system RAM. Without speculation the same model and quant runs at 11 tok/s; a Qwen 27B Q3_K_M run gives 8.4 tok/s and a Qwen 4B gives 51 tok/s with thinking off and 38 tok/s with it on. User asks whether Linux/ROCm would beat Vulkan on Windows and whether these speeds are normal for the card.

Oct 14, 2026
Tone: mixedAMD hardware
generation:
25.0 tokens/s
quant:
GSQ-RCO

User reports Qwen3.8-Flash-Next at 25 tok/s on an RX 6900 XT installed in a retired HP DL380p server with 172 GB DDR3 and 2x 10-core CPUs. Setup is Strata with llama.cpp and an HTTP router, GSQ-RCO quant at 64k context. The GPU is powered by an external desktop PSU; total draw is 250 W idle and about 450 W while inferring. User also reports Qwen3.8-27B with GSQ-RCO-IQ3_XXS and MTP at 192k context reaching 45 tok/s. The machine is a prototype; user plans a flexible riser and a proper GPU platform, and may add Nvidia P40s in the remaining slots someday.

Oct 6, 2026
Tone: positiveAMD hardware
generation:
30-45 tokens/s
quant:
IQ3_XXS (GGUF)
kv:
q8_0/q4_0
mtp (multi-token prediction):
on

User reports running Qwen3.8-27b (Huihui abliterated, IQ3_XXS) on an RX 6900 XT 16GB with llama.cpp and ROCm 10. Prefill drops from 400 t/s to 260 t/s at 40k context; decode varies between 30 t/s and 45 t/s. Setup uses 100k context, KV cache q8_0/q4_0, flash attention, ngram-mod, MTP with n=2, and mmproj in system RAM; VRAM fills to 15.7/16 GB.

Sep 26, 2026

Get a weekly email of new AMD RX 6900 XT 16GB reports and newly released models that fit it.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardwareQuant / engineReported contextGeneration
Qwen3.8 125B (6B active) Flash-Next
AMD RX 6900 XT 16GB
Q2_0
Strata
65,53641.5 tokens/s
Qwen3.8 27B
AMD RX 6900 XT 16GB
IQ4_XS
LM Studio
Not reported19.0 tokens/s
Qwen3.8 125B (6B active) Flash-Next
AMD RX 6900 XT 16GB
GSQ-RCO
Strata
64,00025.0 tokens/s