llamaperf

Qwen3.8 27B

on 4× AMD RX 7900 XTX · llama.cpp · 51,000 ctx

Tone: positiveAMD hardware
Oct 8, 2026
Throughput
77.0 t/s gen · 1816.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8 (GGUF)

Use cases

coding

Summary

User reports Qwen3.8-27B Q8 at 77 t/s decode at 51K depth and 1,816 t/s prefill over a 51K prompt on four RX 7900 XTX cards after a series of ROCm and llama-server fixes. Setup is 4x RX 7900 XTX on PCIe 4.0 x16 in a Lenovo P620, Q8 weights, a locally patched llama.cpp with MTP speculative decoding. Before the fixes the same run gave 57 t/s decode at 51K and 1,454 t/s prefill; code decode went from 54-61 to 96-110 t/s. The patches are not yet published.