llamaperf

Qwen3.8 27B

on AMD Radeon AI PRO R9700 32GB · llama.cpp

AMD hardware
Sep 7, 2026
Quant
Q4_K_XL (GGUF)

Summary

User asks for real-world sustained t/s on an R9700 with Qwen3.8-27B Q4 at 64K context and above. User cites an AMD blog figure of 51.8 t/s and 5090 benchmarks showing degradation from 75 t/s at 4K to about 26 t/s at 64K. User also asks about MTP speculative decoding stability.