llamaperf

Qwen3.8 27B

on AMD RX 9070 · llama.cpp · 131,072 ctx

Tone: positiveAMD hardware
Oct 9, 2026
Throughput
600.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S (GGUF)
KV cache
q4_0
System RAM
32 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 27B at 600 t/s prefill and 22-26 t/s generation on an RX 9070 16GB. Setup is llama.cpp with IQ3_S GGUF and q4_0 KV cache at 131072 context, using about 15.2GB of VRAM. MTP is not active because it did not improve performance and used more VRAM; generation starts at 26 t/s and degrades to 22 t/s at full context.