llamaperf

Qwen3.8 27B

on AMD RX 7900 XTX · llama.cpp · 200,000 ctx

Tone: negativeAMD hardware
Sep 7, 2026
Throughput
25.0 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
Q8
VRAM reported
24 GB

Summary

User reports Qwen3.8 27B Q4_K_M at 25-35 t/s on an RX 7900 XTX at 80k+ context, dropping to 20-21 t/s at 150k-180k context. Setup is llama.cpp with MTP enabled and a q8_0 KV cache with a q5_1 K cache. User expresses frustration over the speed and power consumption.