llamaperf

Qwen3.8 27B

on AMD RX 7900 XTX · llama.cpp · 106,496 ctx

AMD hardware
Oct 22, 2026
Throughput
78.5 t/s gen · 523.3 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
q8_0
Flash Attention
on
System RAM
32 GB
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-27B at 78.53 t/s generation and 523.33 t/s prompt processing on a Radeon RX 7900 XTX 24GB. Setup is llama.cpp 2.61.0 (Vulkan backend, LM Studio) with Q4_K_M GGUF and q8_0 KV cache at 106496 context, whole model on the single GPU (16.8GB of 24GB VRAM). Speculative decoding was on (MTP + ngram, spec-draft-n-max 2), so the generation figure is an effective speed with draft acceptance of 78/98. Four runs, one request at a time: generation ranged 61.68 to 78.53 t/s across runs. Runs 3 and 4 repeated a cached prompt (588 of 592 tokens), so their prompt speeds are startup time, not prefill. The user runs this model as a daily driver for coding and agent work.