Qwen3.8 27B

on AMD Radeon AI PRO R9700 32GB · llama.cpp

Sep 7, 2026

Throughput

29.0 t/s gen

Quant

Q4_K_XL (GGUF)

VRAM reported

32 GB

Summary

User reports Qwen3.8 27B Q4_K_XL on a Radeon AI PRO R9700 with llama.cpp at 29 TG/s, 76% of a theoretical 38 TG/s. The figure is a theoretical maximum TG/s calculation for dense models. An RTX 5090 with 1.8 TB/s bandwidth is also mentioned.

View source ↗