llamaperf

Qwen3.8 27B

on AMD RX 9060 XT 16GB · llama.cpp · 20,000 ctx

Tone: positiveAMD hardware
Oct 18, 2026
Throughput
42.7 t/s gen · 658.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
KV cache
Q4/Q8
MTP (Multi-Token Prediction)
on
System RAM
24 GB
VRAM reported
16 GB

Summary

User reports Qwen 3.8 27B at 42.7 t/s generation and 658 t/s prefill at 20k context on a single RX 9060 XT 16GB. Setup is a fork of llama.cpp (achyudh/llama.cpp) with an unsloth IQ4_XS GGUF, Q4 KV values with Q8 keys, MTP plus n-gram prediction, and KV cache streaming; 24GB of DDR5 system RAM, 16GB of it used for this model. At 200k context the user reports 35 t/s generation and 300 t/s prefill, with a 262k context target. The user notes the build needed PCIe atomics fixes.